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Abstract of EP1 17301 5 

A recording and reproducing apparatus is disclosed 
which comprises; an input element supplied with video 
slgnais; a recording element for recording the video 
signals input through the input element onto a storage 
medium; a reproducing element for reproducing the 
video signals from the storage medium; a processing 
element for generating display-ready video signals on 
the basis of video monitor image signals supplied by 
the input element and/or on the basis of the 
reproduced video signals furnished by the reproducing 
element; and a controlling element for selectively 
activating, by a single operation of a user, any one of a 
recording monitor image, a dual-screen display image 
made of a recording monitor image and a playback 
image, and a playback Image alone. 



FIQ.1 




Data supplied from the esp@cene t database - Worldwide 



http://v3.espacenet.com/textdoc?DB-EPODOC&IDX=EP1 1 7301 5&F=0 2006-01-1 1 



Page 2 of 102 



(c) 2005 European Patent Office. All rights reserved. 

Video signal recording and reproducing apparatus and method 

Verfahren und Vorrichtung zur Aufnahme und Wiedergabe von Videosignalen 

Appareil et procede pour 1 1 enregistrement et le reproduction d'un signal 

video 

PATENT* ASSIGNEE: 

SONY CORPORATION, (214025), 6-7-35 Kitashinagawa Shinagawa-ku, Tokyo 141, 

(JP) , (Applicant designated States: all) 

INVENTOR: 

Watanabe, Jun, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, (JP) 

Honda, Kei, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, ( JP) 

Ito, Natsuo, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, (JP) 

Yamamoto, Shigeki, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, (JP) 

Nagano, Kae, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, (JP) 

Kita, Yukinori, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, (JP) 

Kondo, Shinya, c/o Intel. Property Department, Sony Corp., 6-7-35 
Kitashinagawa, Shinagawa-ku, Tokyo 141, (JP) 
LEGAL REPRESENTATIVE: 

Horner, David Richard et al (77632), D Young & Co 120 Holborn, London 
EC1N 2DY, (GB) 

PATENT (CC, No, Kind, Date) : 

EP 1173015 

A2 

020116 
(Basic) 
EP 1173015 
A3 

041117 

APPLICATION (CC, No, Date) : 

EP 2001306024 

010712; 

PRIORITY (CC, No, Date) : JP 2000212473 000713 
DESIGNATED STATES: DE ; FR; GB 

EXTENDED DESIGNATED STATES: AL; LT; LV; MK; RO; SI 

INTERNATIONAL PATENT CLASS: H04N-005/781 ; H04N-005/76; H04N-005/445 
ABSTRACT EP 1173015 A2 

A recording and reproducing apparatus is disclosed which comprises: an 
input element supplied with video signals; a recording element for 
recording the video signals input through the input element onto a 
storage medium; a reproducing element for reproducing the video signals 
from the storage medium; a processing element for generating 
display- ready video signals on the basis of video monitor image signals 
supplied by the input element and/or on the basis of the reproduced video 
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signals furnished by the reproducing element; and a controlling element 
for selectively activating, by a single operation of a user, any one of a 
recording monitor image, a dual -screen display image made of a recording 
monitor image and a playback image, and a playback image alone. 
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SPECIFICATION EP 1173015 A2 

BACKGROUND OF THE INVENTION 

The present invention relates to an apparatus and a method for 
recording and reproducing video signals to and from a storage medium. 
In recent years, techniques have been proposed and developed to allow 
systems designed for rapid data access to record and reproduce data 
simultaneously to and from a high-speed storage medium such as discs. 
Some inconveniences have been experienced during the development. Users 
tend to be confused when presented with a recording monitor screen and a 
playback screen displayed merely side by side. Faced with the two 
screens, the user can lose track of whether the recording monitor screen 
or the playback screen is currently subject to the ongoing operation. 
Hence the increased possibility of the user committing errors during 
operations . 

When recording and reproduction are performed simultaneously, one of 
the two screens can be put on full-screen display. In that case, however, 
the user is liable to become uncertain about which screen is currently on 
display. 

It is therefore an object of the present invention to alleviate the 
above deficiencies of the related art. 

SUMMARY OF THE INVENTION 

Embodiments of the invention provide an apparatus and a method for 
recording and reproduction whereby a recording monitor screen and a 
playback screen are clearly indicated as such when on display. 
Embodiments of the present invention further provide an apparatus and a 
method for recording and reproduction for implementing an interface 
designed to substantially eliminate errors of users' operations during 
simultaneous execution of recording and reproduction. 

According to a first aspect of the present invention, there is provided 
a recording and reproducing apparatus comprising: an input element 
supplied with video signals; a recording element for recording the video 
signals input through the input element onto a storage medium; a 
reproducing element for reproducing the video signals from the storage 
medium; a processing element for generating display- ready video signals 
on the basis of video monitor image signals supplied by the input element 
and/or on the basis of the reproduced video signals furnished by the 
reproducing element; and a controlling element for selectively 
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activating, by a single operation of a user, any one of a recording 

monitor image, a dual -screen display image made of a recording monitor 

image and a playback image, and a playback image alone. 

In one preferred structure according to the invention, the processing 

element may generate a display screen indicative of the screen monitor 

image being selected when the dual -screen display image is currently on 

display. 

According to a second aspect of the invention, there is provided a 
recording and reproducing apparatus comprising: an input element supplied 
with video signals; a recording element for recording the video signals 
input through the input element onto a storage medium; a reproducing 
element for reproducing the video signals from the storage medium,- a 
processing element for generating display-ready video signals on the 
basis of video monitor image signals supplied by the input element and/or 
on the basis of the reproduced video signals furnished by the reproducing 
element; and a controlling element for making operations of a user 
effective on one of a recording monitor image and a playback image 
constituting a dual-screen display. 

In another preferred structure according to the invention, the 
controlling element may cause the processing element to enlarge the 
currently selected image on display. 

According to a third aspect of the invention, there is provided a 
recording and reproducing apparatus comprising: an input element supplied 
with video signals; a recording element for recording the video signals 
input through the input element onto a storage medium; a reproducing 
element for reproducing the video signals from the storage medium; a 
processing element for generating display- ready video signals on the 
basis of video monitor image signals supplied by the input element and/or 
on the basis of the reproduced video signals furnished by the reproducing 
element; and a controlling element which, when a follow-up playback is 
catching up with an on-air recording, then activates a full-screen 
display of a recording monitor image while giving a sign indicating that 
the recording monitor image is now activated and on full -screen display. 
According to a fourth aspect of the invention, there is provided a 
recording and reproducing apparatus comprising: an input element supplied 
with video signals; a recording element for recording the video signals 
input through the input element onto a storage medium; a reproducing 
element for reproducing the video signals from the storage medium; a 
processing element for generating display-ready video signals 
constituting a recording monitor image and a playback image in a 
dual-screen display, on the basis of video monitor image signals supplied 
by the input element as well as on the basis of the reproduced video 
signals furnished by the reproducing element; and a controlling element 
for giving a sign indicative of ongoing recording near the recording 
monitor image, and another sign indicative of ongoing playback near the 
playback image. 

In a further preferred structure according to the invention, when 
recording is stopped, the sign indicative of ongoing recording may be 
erased. 

In an even further preferred structure according to the invention, when 
playback is stopped through an operation by a user, the sign indicative 
of ongoing playback may be replaced by another sign indicative of a 
pause, with the playback image turned into a still image. 
According to a fifth aspect of the invention, there is provided a 
recording and reproducing method comprising the steps of: recording input 
video signals onto a storage medium; reproducing the video signals from 
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the storage medium; generating display- ready video signals on the basis 
of video monitor image signals derived from the input video signals 
and/or on the basis of the reproduced video signals; and selectively 
activating, by a single operation of a user, any one of a recording 
monitor image, a dual-screen display image made of a recording monitor 
image and a playback image, and a playback image alone. 
According to a sixth aspect of the invention, there is provided a 
recording and reproducing method comprising the steps of: recording input 
video signals onto a storage medium; reproducing the video signals from 
the storage medium; generating display- ready video signals on the basis 
of video monitor image signals derived from the input video signals 
and/or on the basis of the reproduced video signals; and making 
operations of a user effective on one of a recording monitor image and a 
playback image constituting a dual-screen display. 

According to a seventh aspect of the invention, there is provided a 
recording and reproducing method comprising the steps of: recording input 
video signals onto a storage medium; reproducing the video signals from 
the storage medium; generating display- ready video signals on the basis 
of video monitor image signals derived from the input video signals 
and/or on the basis of the reproduced video signals; and when a follow-up 
playback is catching up with an on-air recording, then activating a 
full-screen display of a recording monitor image while giving a sign 
indicating that the recording monitor image is now activated and on 
full-screen display. 

According to an eighth aspect of the invention, there is provided a 
recording and reproducing method comprising the steps of: inputting video 
signals; recording input video signals onto a storage medium; reproducing 
the video signals from the storage medium; generating display- ready video 
signals constituting a recording monitor image and a playback image in a 
dual -screen display, on the basis of video monitor image signals derived 
from the input video signals as well as on the basis of the reproduced 
video signals; and giving a sign indicative of ongoing recording near the 
recording monitor image, and another sign indicative of ongoing playback 
near the playback image. 

As outlined above and through the use of the recording and reproducing 
apparatus of embodiments of the first aspect of the invention and the 
recording and reproducing method of embodiments of the fifth aspect 
thereof, input video signals are recorded onto a storage medium and 
reproduced from there. Display-ready video signals are generated on the 
basis of the reproduced video signals. Any one of a recording monitor 
image, a dual-screen display image made of a recording monitor image and 
a playback image, and a playback image alone is selectively activated by 
a single operation of a user. 

As outlined and through the use of the recording and reproducing 
apparatus of embodiments of the second aspect of the invention and the 
recording and reproducing method of embodiments of the sixth aspect 
thereof, input video signals are recorded onto a storage medium and 
reproduced from there. Display-ready video signals are generated on the 
basis of video monitor image signals derived from the input video signals 
and/or on the basis of the reproduced video signals. Operations of a user 
are then made effective on one of a recording monitor image and a 
playback image constituting a dual-screen display. 
Through the use of the recording and reproducing apparatus of 
embodiments of the third aspect of the invention and the recording and 
reproducing method of embodiments of the seventh aspect thereof, input 
video signals are recorded onto a storage medium and reproduced from 

® 2006 Thomson/West. No Claim to Orig . U.S. Govt. Works. 



httD://orintwestlaw.con^^ 1/17/2006 



Page 6 of 102 



there. Display-ready video signals are generated on the basis of video 
monitor image signals derived from the input video signals and/or on the 
basis of the reproduced video signals. When a follow-up playback is 
catching up with an on-air recording, a full-screen display of a 
recording monitor image is activated together with a sign indicating that 
the recording monitor image is now activated and on full- screen display. 
Through the use of the recording and reproducing apparatus of 
embodiments of the fourth aspect of the invention and the recording and 
reproducing method of embodiments of the eighth aspect thereof, input 
video signals are recorded onto a storage medium and reproduced from 
there. Display-ready video signals constituting a recording monitor image 
and a playback image in a dual -screen display are generated on the basis 
of video monitor image signals derived from the input video signals as 
well as 

on the basis of the reproduced video signals. A sign indicative 
of ongoing recording is given near the recording monitor image, along 
with another sign indicative of ongoing playback near the playback image. 
Further particular and preferred aspects of the present invention are 
set out in the accompanying independent and dependent claims. Features of 
the dependent claims may be combined with features of the independent 
claims as appropriate, and in combinations other than those explicitly 
set out in the claims. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be described further, by way of example 
only, with reference to preferred embodiments thereof as illustrated in 
the accompanying drawings, in which: 

Fig. 1 is a block diagram showing a typical configuration of a video 
signal recording and reproducing apparatus embodying the invention; 
Fig. 2 is a flowchart of stepB in which the apparatus of Fig. 2 
operates in recording; 

Fig, 3 is a schematic view of a typical display derived from video 
signals; 

Fig. 4 is a schematic view of another typical display derived from 
video signals; 

Fig. 5 is a schematic view of another typical display derived from 
video signals; 

Fig, 6 is a schematic view of another typical display derived from 
video signals; 

Fig. 7 is a schematic view of another typical display derived from 
video signals; 

Fig, 8 is flowchart of steps in which the apparatus of Fig. 1 operates 
in simultaneous recording and reproduction; 

Fig. 9 is a flowchart of steps in which the apparatus of Fig. l 
operates in recording; 

Fig. 10 is a schematic view of another typical display derived from 
video signals; 

Fig. 11 is a schematic view of another typical display derived from 
video signals; 

Fig. 12 is a schematic view of another typical display derived from 
video signals; 

Fig. 13 is a schematic view of another typical display derived from 
video signals; 

Fig. 14 is a schematic view of another typical display derived from 
video signals; and 

Fig. 15 is a block diagram showing a typical configuration of another 
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video signal recording and reproducing apparatus embodying the invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention in the form of apparatuses and 
methods for recording and reproducing signals will now be described with 
reference to the accompanying drawings. First to be described is a 
recording and reproducing apparatus capable of recording and reproducing 
video signals to and from a storage medium simultaneously. The storage 
medium may be any one of the following: optical discs such as DVD-RAMs 
(writable digital versatile discs) , magnetic discs such as hard discs, 
and semiconductor memories to and from which data may be written and read 
independently. 

The video signal recording and reproducing apparatus shown in Fig. 1 
comprises: a tuner 1 for receiving RF signals input via an antenna; a 
switch 2 for receiving a composite input from the outside and a composite 
signal from the tuner l and selectively outputting one of the two inputs; 
a YC separation circuit 3 that subjects the composite signal coming from 
the switch 2 to YC separation; a pre-processor 5 for effecting various 
video signal processes such as prefiltering of luminance and color 
difference signals supplied by the YC separation circuit 3; an encoder 6 
for generating an elementary stream by subjecting video signals coming 
from the pre-processor 5, e.g. to MPEG compression coding; an ECC 
modulation circuit 8 which adds an error correcting code to the video 
signals compression-coded by the encoder 6 and which modulates the 
compression- coded video signals supplemented with the error correcting 
code; a recording circuit 9 for converting the signals coming from the 
ECC modulation circuit 8 into recording signals; and a read/write head 10 
that writes and reads signals to and from a storage medium 22 in 
accordance with the recording signals coming from the recording circuit 
9. 

As illustrated in Fig. 1, the video signal recording and reproducing 
apparatus further includes: a playback circuit 11 for generating digital 
signals through binarization of RF signals reproduced by the read/write 
head 10; an ECC demodulation circuit 13 which demodulates the digital 
signals from the playback circuit 11 and which subjects the demodulated 
digital signals to error correction; a decoder 14 for acquiring video 
signals by subjecting the digital signals coming from the ECC 
demodulation circuit 13 , e.g. to MPEG decompression decoding; a 
post-processor 15 which effects a switchover between the 
decompression-decoded video signals from the decoder 14 and the video 
signals coming from the pre-processor 5 and which performs various 
image-related processes such as composition, noise filtering and pixel 
interpolation; an adder 16 that adds the image signals from the 
post -processor 15 to characters, icons and menu images supplied by an OSD 
18 for composition; and an NTSC/PAL encoder 17 which converts the video 
signals coming from the adder 16 into YC signals before acquiring an 
analog composite signal through D/A conversion. 

In addition, the video signal recording and reproducing apparatus shown 
in Fig. 1 has a system controller 19 that causes a driver 21 to control 
read and write positions of the read/write head 10 in accordance with 
recording, playback or simultaneous recording and playback mode 
designated by the user via a user interface 20. The system controller 19 
causes the post-processor 15 to switch display status in keeping with 
various display modes such as dual -screen mode, playback screen mode, and 
recording monitor screen mode designated by the user through the user 
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interface 20. Furthermore, the system controller 19 causes the OSD 18 to 
retrieve from a memory, not shown, icons and messages for identifying the 
currently selected display mode and to feed what is retrieved to the 
adder 16. 

Described below with reference to Figs. 2 through 7 is how the system 
controller 19 causes the post-processor 15 to switch images on a display 
screen in keeping with the user's operation. 

The system controller 19 starts recording either when detecting a 
recording instruction given by the user through the user interface or 
when judging that a predetermined time is reached. 
In step 51 of Fig. 2, the system controller 19 causes the 
post -processor 15 to give a full-screen display of a recording monitor 
image derived from video signals coming from the pre-processor 5, as 
shown in Fig. 3. At the same time, the system controller 19 causes the 
OSD 18 to display in the bottom right corner of the screen an icon 31 
indicating that the screen now on display is a monitor screen of the 
video signals being recorded. The icon 31 is made to disappear 
automatically upon elapse of a predetermined time period from the start 
of recording. Alternatively, the icon 31 may be arranged to remain where 
it is until a specific operation is performed by the user or until a 
display mode switchover is effected. 

In step 52, the system controller 19 checks to see if an end of 
recording is designated through the user interface or if a predetermined 
recording end time is reached. If the end of recording is judged 
designated, the system controller 19 terminates recording and enters 
standby mode. Otherwise the system controller 19 goes to step 53 and 
checks to see if playback is designated via the user interface. 
If it is judged in step 53 that the user has designated playback of 
either a previously recorded program or the program being currently 
recorded, the system controller 19 starts reproducing the program in 
question. Since recording is still underway, recording and playback will 
be performed simultaneously. Step 53 is followed by step 54 in which the 
system controller 19 causes the postprocessor 15 to give a full -screen 
display of a playback image as shown in Fig. 4. At the same time, the 
system controller 19 causes the OSD 18 to display two icons 32 and 33 
side by side in the bottom rightcorner of the screen. The icon 32 
symbolically indicates ongoing playback and the icon 33 is indicative of 
recording currently underway as well. 

The term 'follow-up playback' refers to a mode of playback in which the 
currently recorded program is concurrently reproduced before its 
termination from the beginning or from any position preceding the on-air 
recording position of the program. If the speed of playback is higher 
than that of recording, the playback position follows up and eventually 
overtakes the recording position. If the playback speed is the same as 
the recording speed, the distance between the playback position and the 
recording position remains unchanged and recording ends earlier than 
playback . 

In follow-up playback mode, the system controller 19 causes the driver 
21 to alternate the head 10 between the recording position and the 
playback position. The head 10 is designed to record and reproduce data 
at a transfer rate sufficiently higher than the bit rate of video 
signals. When a predetermined quantity of recording data is accumulated 
in a buffer, not shown, the data are written collectively to the storage 
medium while previously reproduced and accumulated data in the buffer are 
being read out in small increments. When the previously reproduced data 
in the buffer are being exhausted, the system controller 19 causes the 
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driver 21 to shift the head 10 to the playback position to replenish the 
buffer with newly reproduced data while coded input data to be recorded 
are being accumulated in the buffer. These processes are repeated so as 
to perform recording and reproduction simultaneously. 

In step 55, the system controller 19 judges whether a recording monitor 
button or a return button is operated via the user interface. If the 
recording monitor button is judged operated, step 56 is reached. In step 
56, the system controller 19 causes the post-processor 15 to give a 
split-screen display composed of a recording monitor screen and a 
playback screen as shown in Fig. 5, At this point, the playback screen is 
made to appear slightly larger than the recording monitor screen. 
Alternatively, the playback screen being selected may be highlighted in 
the regions of its frame. 

In dual-screen split display mode, the system controller 19 causes the 
0SD 18 to display two icons 34 and 35 which, located near the playback 
screen and the recording monitor screen respectively, identify the 
screens as such. Also given are two time indications 36 and 37, the first 
showing the current time of the playback position and the second 
indicating the current time of the recording position. 
In step 57, the system controller 19 judges whether the recording 
monitor button or the return button is operated via the user interface. 
If the recording monitor button is judged operated, step 58 is reached. 
In step 58, the system controller 19 causes the post -processor 15 to give 
a split-screen display composed of a recording monitor screen and a 
playback screen as shown in Fig. 6. At this point, the recording monitor 
screen is made to appear slightly larger than the playback screen. 
Alternatively, the recording monitor screen being selected may be 
highlighted in the regions of its frame. 

When the recording monitor screen is enlarged, the system controller 19 
permits operations by the user only on the recording monitor screen. That 
is, recording may be stopped or brought to a pause while playback is kept 
from being affected by any such operations as stop, pause, slow, or 
high-speed playback at variable speeds. On the other hand, when the 
playback screen is enlarged, the system controller 19 allows operations 
by the user only on the playback screen. In this state, playback is 
subject to any such operations as stop, pause, slow, or high-speed 
playback at variable speeds while recording cannot be brought to a stop 
or to a pause. 

In step 59, the system controller 19 judges whether the recording 
monitor button or the return button is operated via the user interface. 
If the recording monitor button or the return button is judged operated, 
step 54 is reached again, and the system controller 19 causes the 
post-processor 15 to give a full-screen display of the playback screen 
shown in Fig . 4 . 

The above-described split-screen display made up of an enlarged 
recording monitor screen and a smaller playback screen, split-screen 
display constituted by a smaller recording monitor screen and an enlarged 
playback screen, and playback screen only, may be activated by turns in a 
unidirectionally cyclical manner by operation of a single recording 
monitor button furnished on a remote controller. 
Operating the return button in step 55, 57 or 59 brings back the 
full-screen playback display immediately from any display status. 
Described below with reference to Fig. 9 is a a variation of how the 
system controller 19 causes the post-processor 15 to switch images on the 
display screen, not shown. 

The system controller 19 starts recording either when detecting a 
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recording instruction given by the user through the user interface or 
when judging that a predetermined time is reached. 

In step 1 of Fig. 9, the system controller 19 causes the post -processor 
15 to give a full -screen display of a recording monitor image derived 
from video signals coming from the pre-processor 5, as shown in Fig. 3. 
At the same time, the system controller 19 causes the OSD 18 to display 
in the bottom right corner of the screen the icon 31 indicating that the 
screen now on display is a monitor screen of the video signals being 
recorded. The icon 31 is made to disappear automatically upon elapse of a 
predetermined time period from the start of recording. Alternatively, the 
icon 31 may be arranged to remain where it is until a specific operation 
is performed by the user or until a display mode switchover is effected. 
In step 2, the system controller 19 checks to see if an end of 
recording is designated through the user interface or if a predetermined 
recording end time is reached. If the end of recording is judged 
designated, the system controller 19 terminates recording and enters 
standby mode. Otherwise the system controller 19 goes to step 3 and 
checks to see if playback is designated via the user interface. 
If it is judged in step 3 that the user has designated follow-up 
playback, the system controller 19 goes to step 4 and causes the 
post-processor 15 to give a split-screen display composed of a recording 
monitor screen and a playback screen as shown in Fig. 5. At this point, 
the playback screen is made to appear slightly larger than the recording 
monitor screen. 

With the dual-screen split display in effect, the system controller 19 
causes the OSD 18 to display two icons 32 and 33 symbolically indicating 
the playback screen and the recording monitor screen respectively. 
When the playback screen is enlarged, the system controller 19 allows 
operations by the user only on the playback screen. In this state, 
playback is subject to any such operations as stop, pause, slow, or 
high-speed playback at variable speeds while recording cannot be brought 
to a stop or to a pause. 

In step 5, the system controller 19 judges whether the recording 
monitor screen is selected via the user interface. If the recording 
monitor screen is judged selected, the system controller 19 goes to step 
6 and causes the post-processor 15 to make the recording monitor screen 
larger than the playback screen, as illustrated in Fig. 6. 
When the recording monitor screen is enlarged, the system controller 19 
permits operations by the user only on the recording monitor screen. In 
this state, recording may be stopped or brought to a pause while playback 
is kept from being affected by any such operations as stop, pause, or 
playback at variable speeds. 

In step 7, the system controller 19 judges whether the recording 
monitor screen is selected via the user interface. If the recording 
monitor screen is judged selected, the system controller 19 goes to step 
8 and causes the post-processor 15 to give a full-screen recording 
monitor display as shown in Fig. 3. If the recording monitor screen is 
not judged selected, the system controller 19 goes to step 10 and judges 
whether the playback screen is selected via the user interface, 
when a dual-screen split display is replaced by a full-screen recording 
monitor display or playback display, the system controller 19 causes the 
OSD 18 to display an icon for a predetermined period of time in the 
bottom right corner of the screen, the icon informing the user of the 
currently effective display screen mode. More specifically, if the 
dual-screen split display is replaced by a full-screen recording monitor 
display, the system controller 19 causes the OSD 18 to display two icons 
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side by side for a predetermined time period in the bottom right corner 
of the screen, one icon indicating ongoing playback and the other being 
highlighted to represent the recording monitor screen. If the dual -screen 
split display is replaced by a full-screen playback display, the system 
controller 19 causes the OSD 18 also to display two icons side by side 
for a predetermined time period in the bottom right corner of the screen, 
one icon being highlighted to indicate ongoing playback and the other 
representing the recording monitor screen. 

If it is judged in step 10 that the playback screen is selected via the 
user interface, the system controller 19 returns to step 4. In step 4, 
the system controller 19 causes the post-processor 15 to give a 
split-screen display composed of a recording monitor screen and a 
playback screen as shown in Fig. 5, the playback screen being made 
slightly larger than the recording monitor screen. 

In step 9, a check is made to see if the playback screen is selected 
via the user interface. If the playback screen is judged selected, step 6 
is reached again. In step 6, the system controller 19 causes the 
post-processor 15 to make the recording monitor screen slightly larger 
than the playback screen on a split-screen display, as illustrated in 
Fig. 6. 

If the recording monitor screen is not selected in step 5, step 11 is 
reached. In step 11, the system controller 19 checks to see if the 
playback screen is selected via the user interface. If the playback 
screen is judged selected, the system controller 19 goes to step 12 and 
causes the post-processor 15 to give a full-screen playback display as 
shown in Fig. 4. At the same time, the system controller 19 causes the 
OSD 18 to display a highlighted icon 32 indicating that the playback 
screen is now in effect. If the playback screen is not selected in step 
11, step 5 is reached again. 

In step 13, the system controller 19 checks to see if the recording 
monitor screen is selected via the user interface. If the recording 
monitor screen is judged selected in step 13, step 4 is reached again. In 
step 4, the system controller 19 causes the post-processor 15 to give a 
split-screen display composed of a recording monitor screen and a 
playback screen, the playback screen being made slightly larger than the 
recording monitor screen. 

The above-described full-screen recording monitor screen, split-screen 
display made up of an enlarged recording monitor screen and a smaller 
playback screen, split-screen display constituted by a smaller recording 
monitor screen and an enlarged playback screen, and playback screen only, 
may be activated by turns in a bidirectionally cyclical manner by 
operation of direction pointing buttons furnished on the remote 
controller. Alternatively, an operation button for calling up the 
recording monitor screen may be paired with an operation button for 
invoking the playback display on the remote controller. Whereas the 
processes in effect when playback was designated during recording were 
described above, if a previously recorded program is simply being 
reproduced, a full-screen playback display appears as shown in Fig. 7. In 
such a case, the system controller 19 causes the OSD 18 to display in the 
bottom left corner of the screen an icon indicating that playback is 
undeway. If recording is designated in that state, step 58 in Fig. 5 or 
step 6 in Fig. 9 is reached, and the subsequent steps are repeated. 
Described below with reference to Fig. 8 as well as to Figs. 10 through 
14 is how the system controller 19 causes the post-processor 15 
automatically to switch images on the display screen, not shown, with 
recording and playback carried out simultaneously. 
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If recording and playback are performed concurrently (e.g., in 
follow-up playback mode) and if a full-screen playback display is 
underway, then step 21 of Fig. 8 is reached. In step 21, the system 
controller 19 judges whether recording is stopped by operation of the 
user or terminated when a predetermined recording end time is reached. 
When recording is judged terminated, step 22 is reached. In step 22, a 
check is made to see if a split-screen display composed of a recording 
monitor screen and a playback screen is selected. If the split-screen 
display is judged selected, step 23 is reached. In step 23, the system 
controller causes the post-processor 15 to leave the recording monitor 
screen as supplied by the pre-processor 5 (i.e., the same as TV screen) 
while causing the OSD 18 to erase the icon indicative of ongoing 
recording, as shown in Fig. 10. At this point, a channel number 61 may be 
displayed to indicate the number of the currently recorded channel, as 
illustrated in Fig. 10. If the split-screen display is not judged 
selected, step 24 is reached. In step 24, the system controller 19 causes 
the post -processor 15 to give a full -screen TV image (recording monitor 
screen) while causing the OSD 18 to erase the icon indicating ongoing 
recording. Instead of having the icon erased, the system controller 19 
may display an icon 61 indicative of the currently selected channel, as 
shown in Fig . 14 . 

If recording is not judged terminated in step 21, the system controller 
19 goes to step 25 and checks to see if a stop to playback is designated 
by the user via the user interface. If playback is stopped by operation 
of the user, the system controller 19 goes to step 26 and judges whether 
a split-screen display composed of a recording monitor screen and a 
playback screen is selected. If the split-screen display is judged 
selected, step 27 is reached. In step 27, the system controller 19 causes 
the post-processor 15 to turn the playback screen into a still image and 
bring about playback pause mode while causing the OSD 18 to substitute a 
pause- indicating icon 62 for the icon 34 representing ongoing playback on 
the side of the playback screen, as shown in Fig. 11. If the split-screen 
display is not judged selected, step 28 is reached. In step 28, the 
system controller 19 causes the post -processor 15 to turn the playback 
screen into a still image and bring about playback pause mode while 
causing the OSD 18-to substitute a pause- indicating icon 63 for the icon 
32 representing ongoing playback, as depicted in Fig. 12. 
If in step 25 playback is not judged stopped by the user, step 29 is 
reached. In step 29, the system controller 19 judges whether the playback 
position is catching up with the recording position during follow-up 
playback. If the recording position is judged overtaken, with the 
follow-up playback coming to an end, then step 30 is reached. In step 30, 
a check is made to see if a split-screen display made of a recording 
monitor screen and a playback screen is selected. If the split-screen 
display is judged selected, step 31 is reached. In step 31, the system 
controller 19 causes the post-processor 15 to display the playback screen 
in black or in blue while causing the OSD 18 to erase the icon 34 
indicating ongoing playback, as illustrated in Fig. 13. If the 
split-screen display is not judged selected, step 32 is reached. In step 
32, the system controller 19 causes the post -processor 15 to give a 
full-screen 

recording monitor display while displaying the 

recording- indicating icon replacing the playback icon, as shown in Fig. 
3. At this point, the system controller 19 may cause the OSD 18 to give a 
message saying that a recording monitor screen is now on display or that 
playback has now caught up with recording. 
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If in step 29 the playback position is not judged to have caught up 

with the recording position, with follow-up playback still underway, then 

step 21 is reached again. 

Fig, 15 is a block diagram showing a typical configuration of another 
video signal recording and reproducing apparatus embodying the invention. 
A CPU 91 in Fig. 15 controls the overall operation of a computer 150. The 
CPU 91 is connected to a ROM 92 and a RAM 93 via a bus 94. Programs and 
fixed data needed by the CPU 91 for control processes are stored in the 
ROM 92, Various data including working data necessary for processing by 
the CPU 91 are accommodated in the RAM 93. 

The CPU 91 is connected to an input/output interface 95 via the bus 94 . 
Various processing blocks are interconnected via the I/O interface 95. 
An input unit 96 is constituted by such input devices as a keyboard and 
a mouse. The user of the computer 150 enters various commands through the 
input unit 96. 

An output unit 97 and a display unit 98 are made up of speakers and an 
LCD or a CRT. These components output (display) results of the processing 
by the CPU 91. 

A storage unit 99 is composed of hard discs that store various kinds of 
information and programs managed by the user of the computer 150. 
A communication unit 100 is used to communicate with various terminals 
via a network 9. 

The I/O interface 95 is connected to a drive 101. The drive 101 writes 
and reads data to and from such storage media as magnetic discs 102 
(including floppy discs), optical discs 103 (including CD-ROMs (Compact 
Disc-Read Only Memory) and DVDs (Digital Versatile Disc)), 
magneto-optical discs (including MDs (Mini-Disc)), and semiconductor 
memories 105 . 

The series of processes and steps described above may be executed 
either by hardware or by software. For software-based processing to take 
place, programs constituting the software may be either incorporated 
beforehand in dedicated hardware or installed upon use from a suitable 
program storage medium into a general -purpose personal computer or like 
equipment. For example, the applicant's proprietary software may be 
installed into the computer 150 and executed thereby to implement the 
necessary functions. 

The software for executing the series of processes or steps described 
above may be installed upon use into the computer for execution, carried 
by a suitable program storage medium such as the magnetic disc 102, 
optical disc 103, magneto-optical disc 104 or semiconductor memory 105 
shown in Fig. 15. The programs constituting the software are read from 
the storage medium by the drive 101 and written to the hard discs in the 
storage unit 99. The programs placed in the storage unit 99 are loaded 
into the RAM 90 for execution in accordance with the commands from the 
CPU 91 responding to the instructions entered by the user through the 
input unit 96 . 

As described, the recording and reproducing apparatus according to an 
embodiment of the invention allows the split-screen display made up of an 
enlarged recording monitor screen and a smaller playback screen, 
split-screen display constituted by a smaller recording monitor screen 
and an enlarged playback screen, and playback screen only, to be switched 
toggle-style in keeping with the user's operations. The inventive 
apparatus, prompted by simple operations, thus provides a visual 
indication of the current recording and playback status. 
According to the recording and reproducing apparatus of an embodiment 
of the invention, a single user operation is sufficient to switch by 
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turns the split-screen display of the enlarged recording monitor screen 
and smaller playback screen, split-screen display of the smaller 
recording monitor screen and enlarged playback screen, and playback 
screen only. 

When the split-screen display is in effect, the inventive recording and 
reproducing apparatus preferably displays an icon indicating the 
recording monitor screen and another icon representing the playback 
screen. This feature allows the user to identify the two screens in a 
simple but distinct manner. 

While recording and playback are simultaneously underway, the recording 
and reproducing apparatus of an embodiment of the invention displays a 
recording icon and a display icon side by side. This makes it possible 
for the user easily to recognize the operating status of the apparatus. 
When recording ends first during a simultaneous recording-playback 
process, the inventive recording and reproducing apparatus preferably 
erases the recording icon or displays a message saying that recording has 
ended. This feature allows the user to recognize the end of recording 
while playback is still underway. 

When playback is catching up with recording during follow-up playback 
and playback is thus terminated, the recording and reproducing apparatus 
according to an embodiment of the invention automatically activates a 
full-screen recording monitor display. At the same time, the apparatus 
erases the playback icon or displays a message saying that playback has 
come to an end. This feature eliminates a sense of awkwardness that may 
be experienced by the user upon an abrupt transition from one screen 
display to another. 

Furthermore, if playback is stopped by the user's operation during a 
simultaneous recording-playback process, the inventive recording and 
reproducing apparatus preferably activates a playback pause screen. This 
allows the user to visually confirm to what point the playback 
progressed, thus making it easy for the user later to resume the playback 
exactly from where it was stopped. 

Although particular embodiments have been described herein, it will be 
appreciated that the invention is not limited thereto and that many 
modifications and additions thereto may be made within the scope of the 
invention. For example, various combinations of the features of the 
following dependent claims can be made with the features of the 
independent claims without departing from the scope of the present 
invention . 

CLAIMS EP 1173015 A2 

1. A recording and reproducing apparatus comprising; 
an input element supplied with video signals; 

a recording element for recording said video signals input through said 
input element onto a storage medium; 

a reproducing element for reproducing said video signals from said 
storage medium; 

a processing element for generating display- ready video signals on the 
basis of video monitor image signals supplied by said input element 
and/or on the basis of the reproduced video signals furnished by said 
reproducing element; and 

a controlling element for selectively activating, by a single operation 
of a user, any one of a recording monitor image, a dual -screen 
display image made of a recording monitor image and a playback image, 
and a playback image alone. 

2. A recording and reproducing apparatus according to claim 1, wherein 
said processing element generates a display screen indicative of said 
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screen monitor image being selected when said dual-screen display 
image is currently on display. 

3. A recording and reproducing apparatus comprising: 
an input element supplied with video signals; 

a recording element for recording said video signals input through said 
input element onto a storage medium; 

a reproducing element for reproducing said video signals from said 
storage medium ; 

a processing element for generating display- ready video signals on the 
basis of video monitor image signals supplied by said input element 
and/or on the basis of the reproduced video signals furnished by said 
reproducing element; and 

a controlling element for making operations of a user effective on one 
of a recording monitor image and a playback image constituting a 
dual -screen display, 

4. A recording and reproducing apparatus according to claim 3, wherein 
said controlling element causes said processing element to enlarge 
the currently selected image on display. 

5. A recording and reproducing apparatus comprising: 
an input element supplied with video signals; 

a recording element for recording said video signals input through said 
input element onto a storage medium; 

a reproducing element for reproducing said video signals from said 
storage medium; 

a processing element for generating display-ready video signals on the 
basis of video monitor image signals supplied by said input element 
and/or on the basis of the reproduced video signals furnished by said 
reproducing element; and 

a controlling element which, when a follow-up playback is catching up 
with an on-air recording, then activates a full-screen display of a 
recording monitor image while giving a sign indicating that said 
recording monitor image is now activated and on full -screen display. 

6. A recording and reproducing apparatus comprising: 
an input element supplied with video signals; 

a recording element for recording said video signals input through said 
input element onto a storage medium; 

a reproducing element for reproducing said video signals from said 
storage medium; 

a processing element for generating display- ready video signals 
constituting a recording monitor image and a playback image in a 
dual-screen display, on the basis of video monitor image signals 
supplied by said input element as well as on the basis of the 
reproduced video signals furnished by said reproducing element; and 
a controlling element for giving a sign indicative of ongoing recording 
near said recording monitor image, and another sign indicative of 
ongoing playback near said playback image. 

7. A recording and reproducing apparatus according to claim 6, wherein, 
when recording is stopped, then said sign indicative of ongoing 
recording is erased. 

8. A recording and reproducing apparatus according to claim 6, wherein, 
when playback is stopped through an operation by a user, then said 
sign indicative of ongoing playback is replaced by another sign 
indicative of a pause, with said playback image turned into a still 
image . 

9. A recording and reproducing method comprising the steps of: 
recording input video signals onto a storage medium; 
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reproducing the video signals from said storage medium; 
generating display-ready video signals on the basis of video monitor 
image signals derived from said input video signals and/or on the 
basis of the reproduced video signals; and 

selectively activating, by a single operation of a user, any one of a 
recording monitor image, a dual -screen display image made of a 
recording monitor image and a playback image, and a playback image 
alone. 

10. A recording and reproducing method comprising the steps of: 
recording input video signals onto a storage medium; 
reproducing the video signals from said storage medium; 
generating display- ready video signals on the basis of video monitor 
image signals derived from said input video signals and/or on the 
basis of the reproduced video signals; and 

making operations of a user effective on one of a recording monitor 
image and a playback image constituting a dual-screen display. 

11. A recording and reproducing method comprising the steps of: 
recording input video signals onto a storage medium; 
reproducing the video signals from said storage medium; 
generating display-ready video signals on the basis of video monitor 
image signals derived from said input video signals and/or on the 
basis of the reproduced video signals; and 

when a follow-up playback is catching up with an on-air recording, then 
activating a full -screen display of a recording monitor image while 
giving a sign indicating that said recording monitor image is now 
activated and on full-screen display. 

12. A recording and reproducing method comprising the steps of: 
inputting video signals; 

recording input video signals onto a storage medium; 
reproducing the video signals from said storage medium; 

generating display- ready video signals constituting a recording monitor 
image and a playback image in a dual -screen display, on the basis of 
video monitor image signals derived from said input video signals as 
well as on the basis of the reproduced video signals; and 
giving a sign indicative of ongoing recording near said recording 
monitor image, and another sign indicative of ongoing playback near 
said playback image. 

13. A program storage medium which stores a program for causing a 
computer to execute the steps of : 

recording input video signals onto a storage medium; 

reproducing the video signals from said storage medium; 

generating display- ready video signals on the basis of video monitor 

image signals derived from said input video signals and/or on the 

basis of the reproduced video signals; and 

selectively activating, by a single operation of a user, any one of a 
recording monitor image, a dual -screen display image made of a 
recording monitor image and a playback image, and a playback image 
alone. 

14. A program storage medium which stores a program for causing a 
computer to execute the steps of : 

recording input video signals onto a storage medium; 

reproducing the video signals from said storage medium; 

generating display- ready video signals on the basis of video monitor 

image signals derived from said input video signals and/or on the 

basis of the reproduced video signals; and 

making operations of a user effective on only selected one of a 
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recording monitor image and a playback image constituting a 
dual -screen display. 

15. A program storage medium which stores a program for causing a 
computer to execute the steps of : 

recording input video signals onto a storage medium; 

reproducing the video signals from said storage medium; 

generating display-ready video signals on the basis of video monitor 

image signals derived from said input video signals and/or on the 

basis of the reproduced video signals; and 

when a follow-up playback is catching up with an on-air recording, then 
activating a full -screen display of a recording monitor image while 
giving a sign indicating that said recording monitor image is now 
activated and on full -screen display. 

16. A program storage medium which stores a program for causing a 
computer to execute the steps of: 

recording input video signals onto a storage medium; 
reproducing the video signals from said storage medium; 

generating display- ready video signals constituting a recording monitor 
image and a playback image in a dual -screen display, on the basis of 
video monitor image signals derived from said input video signals as 
well as on the basis of the reproduced video signals; and 
giving a sign indicative of ongoing recording near said recording 
monitor image, and another sign indicative of ongoing playback near 
said playback image. 

END OF DOCUMENT 



® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



httn://nrint.west1aw com/He1Werv.htni1?dest=afn^r fnrmat=HTMT .F.^dataiH=RnOSSROOnOO 1 /I 7/7006 



Page 18 of 102 



(c) 2005 European Patent Office. All rights reserved. 

Broadcast receiver, broadcast control method, and computer readable 

recording medium 

Rundfunkempf anger, Rundfunksteuerverf ahren und vom Computer lesbares 
Auf nahmemedium 

Recepteur de teledif fusion, methode de controle de teledif fusion et moyen 
d'enregistrement lisible par ordinateur 
PATENT ASSIGNEE : 

FUJITSU LIMITED, (211463), l-l, Kamikodanaka 4-chome, Nakahara-ku, 
Kawasaki-shi, Kanagawa 211-8588, (JP) , (Proprietor designated states: 
all) 

INVENTOR : 

Nakamura, Yasufumi, c/o Fujitsu Limited, 1-1, Kamikodanaka 4-chome, 
Nakahara-ku, Kawasaki-shi , Kanagawa 211-8588, (JP) 

Ito, Tetsunori, c/o Fujitsu Personal, Computer Systems Limited, 1405, 
Ooaza, Oomaru, Inagi-shi, Tokyo, (JP) 
LEGAL REPRESENTATIVE: 

Mohun, Stephen John (76153), Haseltine Lake & Co., Imperial House, 

15-19 Kingsway, London WC2B 6UD, (GB) 

PATENT (CC, No, Kind, Date) : 

EP 1158791 

A2 

011128 

(Basic) 

EP 1158791 

A3 

031008 

EP 1158791 

Bl 

051116 

APPLICATION (CC, No, Date) : 

EP 2001301611 

010222; 

PRIORITY (CC, No, Date) : JP 2000155256 000525 
DESIGNATED STATES: DE; FR; GB 

EXTENDED DESIGNATED STATES: AL; LT; LV; MK; RO; SI 

INTERNATIONAL PATENT CLASS: G06F-001/32; H04N-005/76; H04N-005/445 
ABSTRACT EP 11587 91 A2 

A broadcast receiver is provided. This broadcast receiver is capable of 
avoiding such a problem that an audience may lose interest as to a 
broadcast program even in a CM (commercial message) broadcasting time 
range contained in this broadcast program, while the audience need not 
perform a rapid channel changing or 'zapping' operation. In the broadcast 
receiver according to the present invention, a single set of highlight 
scene, or plural sets of highlight scenes are detected from a broadcast 
program provided to the audience, and then, are stored in a storage 
device. Thereafter, when a CM broadcast program is commenced, the 
highlight scene is read out from the storage device so as to be 
reproduced. 
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SPECIFICATION EP 1158791 A2 
The present invention 

generally relates to a broadcast receiver, a 

broadcast control method, and a computer readable recording medium. More 
specifically, the present invention is directed to a broadcast receiver 
and a broadcast control method, which are capable of effectively 
utilizing CM broadcasting time (commercial broadcasting time) within a 
broadcasting program, and also directed to a recording medium for 
recording thereon a computer readable program used to execute the 
broadcast control method. 

Very recently, various sorts of broadcasting networks appear in 
addition to the normally available television broadcasting system using 
the ground waves, known as cable television broadcasting systems and 
BS/CS satellite broadcasting systems using satellites. As a result, 
possibilities capable of selecting desirable programs are increased with 
respect to audiences. Also, the analog TV broadcasting systems such as 
the presently available ground wave TV broadcasting system will be 
replaced by the digital TV broadcasting systems such as the CS 
broadcasting system. Both the BS broadcasting systems and the ground wave 
broadcasting systems are decided to be replaced by the digital TV 
broadcasting systems in near future. 

In near future, a watching style called as a 'time shift watching 
(listening/viewing) style 1 may be executed to constitute a 
general -purpose watching style, since low cost and large capacities of 
random-accessible storage media (e.g., hard disks) may be greatly 
realized, and further, the analog broadcasting systems are substituted by 
digital broadcasting systems. 

The time shift watching style implies such a style that random access 
media constituted in a logically-ring-shaped form is prepared as a buffer 
for temporarily storing thereinto reception data, and an audience watches 
a broadcast program while broadcast data received when the broadcast 
program is received is temporarily stored into the random access media. 
Since broadcast program data corresponding to the storage capacities of 
the random access media are saved therein, trick plays such as seek, 
pause, and replay operations may be realized at arbitrary timing within a 
watching broadcasting program by accessing this program data at random. 
In receivers capable of realizing the time shift watching style, 
audiences may repeatedly view so-far-missed scenes. Also, even in such a 
case that a telephone call is made while an audience watches a broadcast 
program and/or a visitor suddenly comes so that the audience leaves from 
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the present location to another location, if the present time is defined 
within a remaining storage capacity of random access media, then the 
audience may temporarily stop watching of the program, and after the 
audience finishes the subject matter, the audience again may restart 
watching the interrupted program content. 

Japanese Patent Application Laid-open No. Hei 6-14274 discloses the 
technique of the television receiver capable of realizing the time shift 
watching style, and also Japanese Patent Application Laid-open Hei 
7-264529 describes the technique of such an apparatus capable of 
realizing the time shift watching style. 

Fig. 38 is a diagram for representing a relationship between address 
positions and reproducing time of writing operation and reading operation 
with respect to a disk which is used as a buffer (will be referred to as 
a 'buffer disk') when the time shift watching style is performed. 
Since a broadcast receiver receives broadcast data in a constant bit 
rate, a data writing rate with respect to a buffer disk is constant. As a 
result, as indicated by a dotted line in Fig. 38, a relationship between 
time and an address during writing operation becomes a straight line, 
Accordingly, since broadcast data is read out from the buffer disk at the 
same rate as the write rate, broadcast data can be reproduced in the 
normal speed. Symbols 1 tO' to ' t2 ' shown in Fig. 38 correspond to 
broadcast data reproduction in the normal speed. 
In such a case that an audience again wishes to watch a broadcast 
program from the beginning portion thereof at the time instant ' t2' shown 
in Fig. 38, a position of an address 'a0' is sought to set a read 
address. Thereafter, if the broadcast data is read at the normal speed 
rate, then the audience can again watch this broadcast program from the 
beginning portion thereof. 

In such a case that the audience wants to reproduce the broadcast data 
in the fast forward mode in the time shift watching style, the read rate 
is set to become higher than the normal rate. This corresponds to the 
time instants • t2' to 't3' shown in Fig. 38. During the time period, the 
inclination of the straight line becomes larger than that when the 
reproduction is performed in the normal speed. 

Symbols 't3* to 't6' shown in Fig. 38 represent that the broadcast data 
is reproduced under time shift condition and also in the normal speed. 
This is called as an offset watching style. In this offset watching 
style, a straight line of a writing rate and also a straight line of a 
reading rate in Fig. 3 8 become in parallel to each other. In this case, a 
delay from the actual broadcasting time instant is equal to (t3 - tl) , 
since a scene which has been broadcasted at the time instant 'tl 1 is 
watched at a time instant 't3'. 

In the case of such a receiver which supports a reverse reproducing 
operation, when the broadcast data is reverse -reproduced, it becomes time 
instants 't6' to ' t7' shown in Fig. 38. Since the broadcast data is read 
from the read address in the reverse direction, the read address is 
decreased while time has passed. The inclination of the straight line 
becomes a negative value. 

When the audience pauses at a certain position while the broadcast data 
is reproduced, as shown in symbols 't7' to 't8' of Fig. 38, there is no 
change in the position of the read address a3, but only time is changed 
from the time instant 't7' to the time instant ^8.' Thereafter, in order 
to catch up the real-time broadcast program, the write address is made 
equal to the read address. In Fig. 38, at the time instant 't8', the 
real-time broadcast program can be caught up. Subsequently, the audience 
can watch the program identical to the real-time broadcast. 
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Since future reception data which has not yet been stored cannot be 
read out from the buffer disk, a solid line which indicates a change in 
reading time cannot be located above a dotted line which represents a 
change in writing time. 

As actions of audiences, a successive channel changing or so-called 
'zapping action (zapping operation)' is usually carried out by these 
audiences. In this zapping action, when a commercial message (CM) program 
is commenced and this CM program has no direct relationship with a 
broadcast program which is being watched by an audience, this audience 
successively changes broadcast channels in order to seek other favorable 
programs. Various technical ideas capable of supporting this zapping 
action have been proposed. 

Japanese Patent Application Laid-open No. Hei 5-316440 discloses the 
following technique of the TV receiver. That is, while the CM program 
contained in the broadcast program is detected from the speech control 
signal of the receiving broadcasting system, this TV receiver 
automatically switches this receiving broadcasting channel to other 
broadcasting channel, or a previously-registered specific channel. 
Furthermore, this patent application discloses such a technical idea that 
even after the present broadcasting channel has been changed into another 
broadcasting channel, the original broadcasting channel is kept under 
reception condition. At the time instant when the CM program of the 
original broadcasting program is ended, the television receiver is 
automatically returned to the original broadcasting channel. 
As to such a technical point that another information is viewed during 
CM broadcasting, Japanese Patent Application Laid-open No. Hei 11-146296 
discloses the technical idea capable of automatically displaying the 
image information such as the Internet home page while the CM program is 
detected. Also, this patent application describes that as the information 
provided instead of the CM program, the retrieved results obtained from 
the various sorts of information database which are stored in the CD-ROM 
and the like are exemplified in addition to the Internet home page. 
In order to recognize a certain scene contained in a picture (video 
image) as a highlight scene, such a tag which may indicate 'highlight 
scene' must be added. A tag may be realized by previously adding tag data 
when broadcast data is transmitted on the side of a transmission station. 
Alternatively, a tag may be added on the side of a receiver. There are 
two tag adding methods executed on the side of the receiver, namely a 
manual tag adding method and an automatic tag adding method. Since such a 
tag indicative of 'highlight scene' is added to broadcast data, there are 
such merits that saved pictures may be simply retrieved, and contents of 
saved pictures may be grasped in short time. 

Various retrieving methods have been proposed as to an automatic 
highlight scene retrieving method. For example, Japanese Patent 
Application Laid-open No. Hei 9-65287 discloses the technique of the 
featured scene listing method. That is, while the specific picture effect 
called 'desolve' contained in the broadcast program is sensed, the scene 
representative of the moving picture is specified. 

However, the above -explained known techniques have the below-mentioned 
problems. That is, the audience is normally relaxed while watching the 
broadcast program at home. Under such a circumstance, the audience never 
performs the time shift watching style unless there is such a specific 
reason that the program watching action by the audience is disturbed by 
the telephone call and/or the visitor. Also, in the prior technique, the 
audience must issue such an instruction by himself, namely, a chance to 
replay a program watched in a real time mode in a half way. 
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The reasons why the zapping operation is carried out by audiences are 
mainly given as follows: 

(1) . In such a case that an audience does not have a clear decision on 
the next program after a presently watched broadcast program is ended, 
this audience has a necessary and positive reason directed to a program 
search, namely the audience roughly checks all of presently watchable 
programs and then searches a favorable program. 

(2) . An audience has such a passive reason: When the audience thinks 
it a waste of time merely to watch a CM program this audience tries to 
search another channel program. Namely the presently watched CM program 
is replaced by the favorable broadcast program. 

(3) . An audience has a positive reason without any necessity: Since 

this audience cannot be satisfied with the presently watched program, the 
audience tries to search the more enjoyable program. 

(4) . A reason is established by combining the above -explained reasons 
(l) to (3) . 

Generally speaking, such a zapping operation becomes effective in such 
a case that an audience can find out more favorable program in another 
channel, as compared with the presently watched program. However, there 
are many possibilities that while a CM program is broadcast in a certain 
channel, CM programs are similarly broadcast in other channels. Finally, 
since the audience could not find out his favorable program in another 
channel, this audience is returned to the originally watched program. 
Moreover, when the audience is returned to the original channel, there 
are many chances that the CM broadcast has already been accomplished, and 
therefore, this audience loses a head portion of a broadcast program 
after this CM broadcast is accomplished. 

Also, since the zapping operation is required to perform the remote 
control many times, this remote control operation may cause very 
cumbersome operations for the audience. In the case that all of channels 
are not always free channels, but some channels are paid-channels, if an 
audience performs the zapping operation under careless condition, then 
the audience mistakenly watches such a paid-channel program, which may 
cause unnecessary expense. 

When the known technique disclosed in Japanese Patent Application 
Laid-open No. Hei 5-316440 is used (namely, CM program is automatically 
detected to change present channel into another channel) , the manual 
cumbersome operation required in the zapping operation can be eliminated. 
However, this known technique could not solve other difficulties. That 
is, the CM programs are similarly broadcast in other channels, and/or no 
other favorable programs are broadcast in other channels. 
On the other hand, when the known technique disclosed in Japanese 
Patent Application Laid-open No. Hei 11-146296 is used (namely, other 
image information is displayed while CM program is broadcasted) , the 
purpose for the CM program substitution (namely, audience watches 
information other than CM program) can be achieved. However, this 
technique cannot meet such a requirement that the audience wishes to 
watch once again the highlight scene of the originally watched program by 
utilizing watching time for the CM program. 

In general, a large number of CM programs are inserted into a time 
duration defined after a broadcast program is ended and before the next 
broadcast program is commenced. Also, spot news programs and weather 
forecast programs are inserted into this time duration. However, it is a 
waste of time when an audience again watches news programs and weather 
forecast programs, which have been already watched/known by this 
audience. As a consequence, the audience tries to change the presently 
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watched channel into another channel. However, there are many 
opportunities that news programs and/or weather forecast programs are 
similarly broadcast in other channels at this channel change time. 
Therefore, the audience could not effectively utilize the time duration 
defined after one program is ended and until the next program is started, 
so that this audience may feel stress. 

Embodiments of the present invention may provide a broadcast receiver, 
a broadcast control method, and also a recording medium for recording 
thereon a computer program, by which an audience can avoid losing 
interest as to a content of a broadcast program even in a CM broadcasting 
time range contained in this broadcast program, while this audience no 
longer performs the zapping operation. 

The present invention aims to solve the above -described problems by 
employing the below-mentioned arrangements: 

That is, a broadcast receiver, according to the present invention, is 
featured by comprising: a highlight scene detecting unit for detecting a 
highlight scene of a broadcast program; means for storing at least the 
detected highlight scene of the program into a storage device; a CM 
detecting unit for detecting a CM (commercial message) broadcast program; 
and a reproducing control unit for reproducing the highlight scene stored 
in the storage device while the CM program is broadcast. 
In the broadcast receiver of the present invention, the CM detecting 
unit includes a CM start detecting unit for detecting a commencement of 
the CM broadcast; and when the CM broadcast is commenced, the 
reproduction of the highlight scene may be commenced. 
In the present invention, a broadcast contains, for instance, a 
television broadcast or a radio broadcast. A broadcast receiver, 
according to the present invention, may be applied to a television 
broadcast receiver, a radio broadcast receiver (e.g., radio broadcasting 
system and/or radio-character broadcasting system), and the like. 
Also, in the present invention, an 'audience 1 may include a person who 
watches a television broadcast program or a person (listener, or 
receiver) who listens to a radio broadcast program. A detection of a 
highlight scene may be realized as follows: A portion capable of 
satisfying a predetermined detection condition may be detected as a 
highlight scene by executing an image recognition process operation 
and/or a speech recognition process operation. Also, such a portion may 
be detected based upon an index contained in broadcast data, or in 
response to an instruction of an audience. 

In accordance with the present invention, while an audience watches a 
broadcast program, when a CM program is commenced, the audience can watch 
a highlight scene of this broadcast program. In this way, the highlight 
scene of the broadcast program can be provided while the CM program is 
broadcast. Thus, the audience need not perform the zapping operation 
which is carried out in the known broadcast receiver. Also, the present 
invention can avoid such a problem that the audience loses interest and 
also concentration with respect to the broadcast program which is being 
watched, which is derived from the fact that the audience mistakenly 
receives other information by watching the CM program and also by 
performing the zapping operation. 

Also, the broadcast receiver, according to the present invention, may 
be arranged by such that the storage device stores thereinto a data 
portion of the broadcast data corresponding to a predetermined time 
duration at any time; and in such a case that when the CM broadcast is 
ended, the reproduction of the highlight scene has not yet accomplished, 
the reproducing control unit reproduces such broadcast data as appeared 
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just after the CM broadcast is ended after the reproduction of the 
highlight scene is reproduced. A term 'broadcast data' involves picture 
(image) data and/or speech (voice) data related to a broadcast program, 
and furthermore, picture (image) data and/or speech (voice) data related 
to a CM program. 

Also, the broadcast receiver, according to the present invention, may 
be arranged by that in such a case that when the broadcast data is 
reproduced, a next CM broadcast is commenced, if a time difference 
between a broadcast time instant and a reproduction time instant exceeds 
broadcast time of the next CM broadcast program, the reproducing control 
unit continues to reproduce the broadcast data without executing the 
reproduction of the highlight scene. A term 'broadcast time instant' 
indicates a time instant elapsed in accordance with a broadcast program 
such as a television and a radio, whereas a term 'reproducing time 
instant' indicates a time instant (actual time instant) when broadcast 
data stored in a storage device is reproduced. 

Also, the broadcast receiver, according to the present invention, may 
have a structure such that the storage device stores thereinto a data 
portion of the broadcast data corresponding to a predetermined time 
duration at any time; and when the CM broadcast is commenced, the 
reproducing control unit reproduces as the highlight scene, a broadcast 
data portion which is stored in the storage device, and is defined from a 
time instant when the CM broadcast is started and until a preselected 
time duration is retraced. 

Also, the broadcast receiver, according to the present invention, may 
have a structure such that the broadcast program contains first speech 
(voice) and second speech (voice) ; and the broadcast receiver may further 
comprise: speech control means for providing any one of the first speech 
and the second speech when the broadcast program is provided in 
connection with a broadcast time instant; and also for providing the 
other speech between the first speech and the second speech when the 
highlight scene is reproduced. 

Also, the broadcast receiver, according to the present invention, may 
be configured such that the broadcast receiver is further comprised of: a 
highlight scene classifying unit for classifying the highlight scenes 
stored in the storage device into plural sorts of classifications; and 
the reproducing control unit reads out such a highlight scene having a 
sort corresponding to a taste of an audience with having a top priority 
from the storage device to reproduce the read highlight in such a case 
that the CM broadcast is commenced. 

Also, the broadcast receiver, according to the present invention, may 
have a structure such that the reproducing control unit reproduces any 
one of the highlight scene and a digest constituted of plural highlight 
scenes of a certain broadcast program during a time period defined after 
the certain broadcast program is ended and until a next broadcast program 
is commenced. 

Further, a broadcast control method, according to the present 
invention, is featured by that a highlight scene of a broadcast program 
is detected; at least the detected highlight scene of the program is 
stored into a storage device; a CM (commercial message) broadcast program 
is detected; and the highlight scene stored in the storage device while 
the CM program is broadcast is reproduced. 

Moreover, a computer readable recording medium for recording thereon a 
computer program, according to the present invention, is featured by such 
a recording medium for recording thereon a program used to cause a 
computer to execute: a step for detecting a highlight scene of a 
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broadcast program; a step for storing at least the detected highlight 
scene of the program into a storage device; a step for detecting a CM 
(commercial message) broadcast program; and a step for reproducing the 
highlight scene stored in the storage device while the CM program is 
broadcast . 

Embodiments of the present invention will now be described, by way of 
example only, with reference to the accompanying drawings, in which: 
Fig. 1 schematically shows a hardware structure of a computer which 
may function as a broadcast receiver according to the present invention; 
Fig. 2 is a functional block diagram of a broadcast receiver according 
to a first embodiment of the present invention; 

Fig. 3 is a diagram for explaining a highlight index storage unit of 

the broadcast receiver according to the first embodiment; 

Fig. 4 is a diagram for explaining a CM index storage unit of the 

broadcast receiver according to the first embodiment; 

Fig. 5 is a flow chart for describing operations of the broadcast 

receiver according to the first embodiment; 

Fig. 6 is a flow chart for describing a highlight analyzing process 
operation of the broadcast receiver according to the first embodiment; 
Figs. 7A and 7B are flow charts for describing both a CM starting 
index storage .process operation and a CM end index storage process 
operation, which are executed in the broadcast receiver according to the 
first embodiment; 

Fig. 8 is a flow chart for describing a highlight selecting process 
operation of the broadcast receiver according to the first embodiment; 
Fig. 9 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk of the broadcast 
receiver according to the first embodiment; 

Fig. 10 is a functional block diagram of a broadcast receiver 
according to a second embodiment of the present invention; 
Fig. 11 is a flow chart for describing a highlight analyzing process 
operation executed in the broadcast receiver according to the second 
embodiment ; 

Fig. 12 is a functional block diagram of a broadcast receiver 
according to a third embodiment of the present invention; 
Fig. 13 is a diagram for explaining an input device (remote 
controller) of the broadcast receiver according to the third embodiment; 
Fig. 14 is a flow chart for describing a highlight analyzing process 
operation executed in the broadcast receiver according to the third 
embodiment ; 

Fig. 15 is a flow chart for describing operations of a broadcast 
receiver according to a fourth embodiment of the present invention; 
Fig. 16 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk employed in the 
broadcast receiver according to the fourth embodiment of the present 
invention; 

Fig. 17 is a diagram for indicating a relationship between a write 
address and a read 

address with respect to a buffer disk employed in a 

broadcast receiver according to a fifth embodiment of the present 

invention; 

Fig. 18 is a diagram for representing a relationship between a. write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a sixth embodiment of the present 
invention; 

Fig. 19 is a diagram for indicating a relationship between a write 
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address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a seventh embodiment of the present 
invention; 

Fig. 20 is a diagram for explaining a highlight index storage unit 
employed in a broadcast receiver according to an eighth embodiment of the 
present invention; 

Fig. 21 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk employed in the 
broadcast receiver according to the eighth embodiment of the present 
invention; 

Fig. 22 is a diagram for indicating a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a ninth embodiment of the present 
invention; 

Fig. 23 is a functional block diagram of a broadcast receiver 
according to a tenth embodiment of the present invention; 
Fig. 24 is a flow chart for describing operations of the broadcast 
receiver according to the tenth embodiment; 

Fig. 25 is a functional block diagram of a broadcast receiver 

according to an 11th embodiment of the present invention; 

Fig. 26 is a functional block diagram of a broadcast receiver 

according to a 12th embodiment of the present invention; 

Fig. 27 is a diagram for explaining a highlight index storage unit 

employed in the broadcast receiver according to the 12th embodiment; 

Fig. 28 is a diagram for explaining a user taste database employed in 

the broadcast receiver according to the 12th embodiment; 

Fig. 29 is a functional block diagram of a broadcast receiver 

according to a 13th embodiment of the present invention; 

Fig. 30 is a flow chart for describing operations of the broadcast 

receiver according to the 13th embodiment; 

Fig. 31 is a diagram for indicating an example of a screen display 
image of the broadcast receiver according to the 13th embodiment; 
Fig. 32 is a flow chart for describing operations of a broadcast 
receiver according to a 14th embodiment of the present invention; 
Fig. 33 is a diagram for indicating an example of a screen display 
image of the broadcast receiver according to the 14th embodiment; 
Fig. 34 is a functional block diagram of a broadcast receiver 
according to a 15th embodiment of the present invention; 
Fig. 35 is a flow chart for describing operations of the broadcast 
receiver according to the 15th embodiment; 

Fig. 36 is a diagram for indicating an example of a screen display 
image of the broadcast receiver according to the 15th embodiment; 
Fig. 37 is a diagram for showing a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a 16th embodiment of the present 
invention; and 

Fig. 38 is a diagram for representing the relationship among the write 
address, the read address, and the reproduction time with respect to the 
buffer disk during time shift watching operation. 

(FIRST EMBODIMENT) 

HARDWARE CONSTRUCTION OF BROADCAST RECEIVER 

Fig. 1 is a hardware structural diagram of a computer 1 which may 
function as a broadcast receiver (will be simply referred to as a 
'receiver 1 hereinafter) according to the present invention, and may 
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realize a broadcast control method according to the present invention. 
The computer 1 corresponds to, for instance, a personal computer, a 
workstation, and the like (so-called 'TV-personal computer 1 ), which is 
equipped with a digital television broadcasting reception function, and 
may function as a television broadcast receiver. 

In Fig. 1, the computer 1 is provided with a CPU (Central Processing 
Unit) 2, a ROM (Read-Only Memory) 3, a RAM (Random Access Memory) 4, a 
hard disk (HD) 5, floppy disk drive (FDD) 6, a CD-ROM drive 7, a display 
control apparatus 8, a communication control apparatus 9, and a plurality 
of interface circuits (I/F) 10 to 12. 

The ROM 3 previously stores thereinto an initiation program. The 
initiation program is executed by the CPU 2 when the power supply of the 
computer 1 is turned ON. As a result, both an operating system (OS) and 
either a single sort, or plural sorts of drive software (drivers) are 
loaded on the RAM 4, so that various sorts of process operations and 
control operations are brought into executable conditions. The single 
sort, or plural sorts of drivers and also the operating system, which 
have been previously stored in the hard disk HD 5, are used to execute a 
display process operation and a communication process operation. 
Various sorts of computer programs for controlling the computer 1 are 
expanded to the RAM 4, and this RAM 4 is used as a work area of the CPU 
2. As a result, the RAM 4 may save a process result by a computer 
program, such temporarily-processed data used to execute a process 
operation, and such display data used to display the process result and 
the like on the display screen on the display apparatus 15. 
The display data expanded on the RAM 4 is transferred via the display 
control apparatus 8 to the display apparatus 15. Upon receipt of the 
display data, the display apparatus 15 displays a display content 
corresponding to the display data on the display screen thereof. 
The HD 5 is a recording medium operable in such a manner that in 
response to an instruction issued from the CPU 2, this recording medium 
records thereon a program, control data, text data, image data, and the 
like. It should be noted that data/program read/write-operations with 
respect to this hard disk HD 5 are executed by a hard disk drive (not 
shown in detail) . 

The floppy disk drive FDD 20 corresponds to such a device used to 
execute either a read operation or a write operation with respect to a 
floppy disk (FD) 13. In response to an instruction issued from the CPU 2, 
this FDD 20 may read/write a program, control data, text data, image 
data, and the like with respect to the FD 13. 

The CD-ROM drive 7 corresponds to such a device capable of reading a 
program and/or data previously recorded on a CD-ROM 14 in response to an 
instruction issued from the CPU 2. The CD-ROM 14 is such a read-only 
memory using a compact disk (CD) . 

The display apparatus 15 is connected to the display control apparatus 
8. The display apparatus 15 is equipped with a monitor and a speaker used 
to output speech. The monitor is constructed of a cathode-ray tube (CRT), 
a liquid crystal display (LCD) , and the like. 

The display control apparatus 8 contains a decoder 8a (see Fig. 2) . The 
decoder 8a decodes, or demodulates both image data and speech (voice, 
sound) data contained in broadcast data inputted into the computer 1 so 
as to obtain such data having a format processable by the display 
apparatus 15. Both the image data and the speech data contained in the 
broadcast data entered into the computer 1 are demodulated by the display 
control apparatus 8, and then, the demodulated image/ speech data are 
processed by way of either the image display control process or the 
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speech output control process, if required, Thereafter, the processed 
image/speech data are supplied to the display apparatus 15. 
To the communication control apparatus 9, a communication line 
connected to a network (not shown) is connected. In response to an 
instruction issued from the CPU 2, the communication control apparatus 9 
transmits/receives (involving uploads/downloads) a program and/or data 
with respect to another computer. 

A keyboard (KBD) 16 is connected to the interface I/F 10. This keyboard 
(KBD) 16 is provided with a plurality of keys (character input keys and 
cursor key etc.) , and is used by an operator in order to input an 
instruction and data to the computer 1. 

Either a mouse 17 or a pointing device such as a track ball, a flat 
space, and a joystick is connected to another interface I/F 11. The mouse 
17 is used to input a selection instruction by employing a cursor 
displayed on the monitor of the display apparatus 15. 

A tuner 18 used to receive a digital television broadcasting program is 
connected to another interface I/F 12. This tuner 18 is connected to an 
antenna 19 for receiving digital television broadcasting electromagnetic 
waves such as CS broadcasting programs. The tuner 18 converts a digital 
TV broadcasting electromagnetic wave into a digital signal containing 
image data and speech data, and then, this converted digital signal is 
entered into the I/F 12. The I/F 12 converts a digital TV signal entered 
from the tuner 12 into such data having a format processable by the 
computer 1, and then, outputs this converted data to the bus BUS. 
The CPU 2 executes various sorts of programs stored in the ROM 3, the 
HD 5, the FD 13, and the CD-ROM 14 (namely, these devices correspond to 
'recording medium' of the present invention) . As a result, the computer 
1 may function as a broadcast receiver according to the present 
invention. It should be understood that the above-described programs and 
also data to be saved in the recording medium such as the HD 5 may be 
recorded on this recording medium by an operator in a manual manner. 
Alternatively, the computer l may download these programs/data from 
another computer to be recorded on the recording medium. 
Furthermore, the arrangement of the computer 1 shown in Fig. 1 may be 
replaced by that in which the tuner 18 is built in the computer 1. Also, 
the decoder may be provided outside this computer 1. 
It should also be noted that the CPU 2 may realize a highlight scene 
detecting unit, a means for storing a highlight scene into a storage 
device, a CM detecting unit, a CM start detecting unit, and a 
reproduction control unit. The hard disk HD 5 (buffer disk 21) 
corresponds to the storage device according to the present invention, 
FUNCTIONAL BLOCK OF BROADCAST RECEIVER 

Fig. 2 is a functional block diagram for showing an arrangement of a 
broadcast receiver according to a first embodiment of the present 
invention. The computer 1 indicated in Fig. 1 may function as a receiver 
20 which is connected to the tuner 18 and the decoder 8a contained in the 
display control apparatus 8, as shown in Fig. 2, since the CPU 2 executes 
a computer program. 

The tuner 18 receives a broadcasting electromagnetic wave received by 
the antenna 19, and then enters both image (video) data and speech 
(audio) data contained in the broadcasting electromagnetic wave into this 
receiver 20. The decoder 8a decodes (demodulates) both the image data and 
the speech data contained in the broadcasting electromagnetic wave, and 
then, supplies the decoded image/speech data to the display apparatus 15. 

As a result, an image data (picture) produced from the image data is 
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displayed on the monitor of the display apparatus 15, and also speech 
(voice) produced from the speech data is outputted from the speaker. 
Therefore, the television broadcast programs may be provided with 
audiences . 

The receiver 20 is equipped with a buffer disk 21, a highlight scene 
analyzing unit 22, a CM start sensing unit 23, a CM end sensing unit 24, 
a highlight index storage unit 25, a CM index storage unit 26, a 
reproducing management unit 27, and a switch 28. The highlight scene 
analyzing unit 22 (will be referred to as an 'analyzing unit 22* 
hereinafter) corresponds to a highlight scene detecting unit. The CM 
start sensing unit 23 corresponds to a CM detecting unit, and a CM start 
detecting unit. The CM end sensing unit 24 corresponds to a CM detecting 
unit. The highlight index storage unit 25 corresponds to a means for 
storing a highlight scene into the storage device. The reproducing 
management unit 27 corresponds to a reproduction control unit. The 
analyzing unit 22, the CM start sensing unit 23, the CM end sensing unit 
24, and also the reproducing management unit 27 are such functions which 
can be realized by that the CPU 2 executes a computer program. 
The buffer disk 21 corresponds to such a ring buffer for temporarily 
storing thereinto broadcast data portions outputted from the tuner 18 
only for a predetermined time duration. When the buffer disk 21 stores 
the broadcast data up to a final address, the next address is returned to 
a head address, while the tuner 18 and the receiver 20 are initiated, 
this buffer disk 21 arbitrarily, or temporarily stores thereinto the 
broadcast data of the selected channel . 

In this example, the buffer disk 21 is constituted by employing a hard 
disk. Alternatively, if random accessible media are available, then any 
type of random accessible media, for example, a RAM disk may be used as 
this buffer disk 21. 

The analyzing unit 22 acquires the broadcast data which is stored from 
the tuner 18 to the buffer disk 21, and then, analyzes the acquired 
broadcast data so as to detect a highlight scene of a broadcasting 
program. This analyzing unit 22 stores index information corresponding to 
the detected highlight scene into the highlight index storage unit 25. 
The analyzing unit 22 detects the highlight scene in accordance with 
both a detection starting condition and a detection end condition of the 
highlight scene, which are previously set, while using both the image 
data and the speech data contained in the broadcast data. In other words, 
the analyzing unit 22 detects as the highlight scene such broadcast data 
defined from a data portion coincident with the detection starting 
condition up to a data portion coincident with the detection end 
condition, as a result of an image recognition process, and a speech 
recognition process, and also a combination of these process operations. 
The analyzing unit 22 sets as a detection starting condition, for 
instance, such a condition that a difference between a preceding frame 
and a succeeding frame within an image is calculated, and an absolute 
value of this difference is larger than a predetermined threshold value, 
and further, a level of speech corresponding to the image is higher than 
a preselected threshold value. Then, the analyzing unit 22 detects image 
data defined from the image portion capable of satisfying this detection 
starting condition up to the image portion capable of satisfying a 
detection end condition as the above-described highlight scene. 
Also, the analyzing unit 22 detects the highlight scene, while a change 
in major colors of a screen is sensed so as to sense a change in 
displayed images, or a change in luminance brightness is utilized. 
Alternatively, the analyzing unit 22 detects as the highlight scene such 
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an image where a specific key word (for example, name of hero) is 
recognized, while the image recognition process is combined with the 
speech recognition process. 

Then, the analyzing unit 22 detects both the starting time instant and 
the end time instant of the highlight scene, the addresses (namely, both 
starting address and end address) of the highlight scene on the buffer 
disk 21, and also the length of the highlight scene. The analyzing unit 

22 stores all of the above-described data into the highlight index 
storage unit 25 as the index information. 

Fig. 3 is an explanatory diagram for explaining the content of the 
highlight index storage unit 25 shown in Fig. 2. As indicated in Fig. 3, 
the highlight index storage unit 25 corresponds to such a table which 
records thereon index information of highlight scenes every highlight 
scene. This index information implies a starting time instant, a starting 
address, an end time instant, an end address, and a length. This table is 
formed on the RAM 4 . 

Returning back to Fig. 2, the CM start sensing unit 23 senses a start 
of a CM (commercial) program contained in a broadcasting program in such 
a manner that the CM start sensing unit 23 judges as a CM starting time 
instant, such a time instant at which a sound mode contained in 
broadcasting data stored in the buffer disk 21 is changed from a monoral 
sound mode to a stereophonic sound mode, when the CM start sensing unit 

23 senses starting of the CM program, this CM start sensing unit 23 
acquires this starting time instant, and the address (starting address) 
of the broadcasting data corresponding to this starting time instant in 
the buffer disk 21. Then, the CM start sensing unit 23 stores the 
acquired CM starting time instant and the starting address into the CM 
index storage unit 26. 

The CM end sensing unit 24 senses an end of a CM (commercial) program 
contained in a broadcasting program in such a manner that the CM end 
sensing unit 24 judges as a CM end time instant, such a time instant at 
which a sound mode contained in broadcasting data stored in the buffer 
disk 21 is changed from a stereophonic sound mode to a monoral sound 
mode. When the CM end sensing unit 24 senses the end of the CM program, 
this CM end sensing unit 24 acquires this end time instant, and the 
address (end address) of the broadcasting data corresponding to this end 
time instant in the buffer disk 21. Then, the CM end sensing unit 24 
stores the acquired CM end time instant and the end address into the CM 
index storage unit 26, 

As the CM start sensing method by the CM start sensing unit 23, or the 
CM end sensing method by the CM end sensing unit 24, either the CM 
starting point or the CM end point may be sensed from a blank image 
portion between two continuous senses by way of a method similar to the 
analyzing unit 22, or may be sensed by utilizing such a fact that a sound 
volume level of a CM program is higher than that of a broadcasting 
program . 

Fig. 4 is an explanatory diagram for explaining the content of the CM 
index storage unit 26 shown in Fig. 2. As indicated in Fig. 4, the CM 
index storage unit 26 corresponds to such a table which records thereon 
index information of a CM program every CM broadcasting band. This index 
information implies a starting time instant, a starting address, an end 
time instant, an end address, and a length. This table is formed on the 
RAM 4. 

Returning back to Fig. 2, the reproducing management unit 27 manages 
reproducing operations of broadcasting data stored in the buffer disk 21 
based upon CM index information and highlight index information. 
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In other words, the reproducing management unit 27 manages both the 
highlight index information stored in the highlight index storage unit 25 
and the CM index information stored in the CM index information storage 
unit 26. At a time instant when a CM broadcast is commenced, the 
reproducing management unit 27 detects the index information of the 
proper highlight scene from the highlight index storage unit 25, and sets 
the read address of the buffer disk 21 to the starting address which is 
written into the detected index information. 

The switch 28 switches the broadcast data inputted from the tuner 18 
and the broadcast data which is time-shifted and is supplied from the 
buffer disk 21 under control of the reproducing management unit 27. 
while one end of the switch 28 is connected to the decoder 8a, any one 
of the broadcast data inputted from the tuner 18 and the broadcast data 
supplied from the buffer disk 21 is entered to this decoder 8a. The 
decoder 8a decodes the entered broadcast data, and the decoded data is 
outputted from the display apparatus 15. It should also be noted that the 
switch 28 need not be physically realized, but may be realized by way of 
a conceptional idea. When this switch 28 is realized in a software 
manner, this switch 28 may be realized by the internal condition 
judgement. In other words, this switch 28 may be realized even by a 
mechanical switch, or an electronic switch. 

The reproducing management unit 27 performs the management of the 
reproducing operation in accordance with the below-mentioned sequential 
operation. In other words, the reproducing management unit 27 detects the 
proper index information from the highlight index storage unit 25 at such 
a time instant when the CM start sensing unit 23 senses the commencement 
of the CM broadcast. Subsequently, the reproducing management unit 27 
sets the starting address of this index to the data read position of the 
buffer disk 21, and also switches the switch 28 to the switch side of the 
buffer disk 21. 

Thereafter, the reproducing management unit 27 reads the broadcast data 
from the buffer disk 21 to supply the read broadcast data to the decoder 
8a until the CM end sensing unit 26 senses the end of this CM broadcast. 
At such a time instant when the CM broadcast is ended, the reproducing 
management unit 27 switches the switch 28 to the switch side of the tuner 
8a. As a result, while the CM program is broadcasted, the highlight scene 
data portion contained in the broadcast data recorded on the buffer disk 
21 is supplied to the decoder 8a. 

Fig. 5 to Fig. 8 are flow charts for representing operations of the 
receiver 20 according to the first embodiment of the present invention. 
Fig, 5 is a flow chart for explaining operations of the receiver 20 when 
broadcast data is received. Fig. 6 is a flow chart for explaining the 
content of the highlight analyzing process operation indicated in Fig. 5. 
Fig. 7(A) is a flow chart for explaining the content of the CM start 
index storage process operation shown in Fig. 5. Fig. 7(B) is a flow 
chart for describing the content of the CM end index storage process 
operation shown in Fig. 5. Fig. 8 is a flow chart for describing the 
content of the highlight selection process operation indicated in Fig. 5. 

The process flow operation indicated in Fig. 5 is commenced by 
initiating the tuner 18, the receiver 20, the decoder 8a, and also the 
display apparatus 15 by turning ON the power supplies thereof in order 
that an audience watches a broadcasting program outputted from the 
display apparatus 15, 

As indicated in Fig. 5, at a step SOI of this flow chart, the CM start 
sensing process operation is executed. In other words, the CM start 
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sensing unit 23 monitors the broadcast data supplied from the tuner 18, 
and judges as to whether or not a CM broadcast is commenced (step S02) . 
At this time, when the CM broadcast is commenced, this CM start sensing 
process is advanced to a step S06, whereas when the CM broadcast is not 
yet commenced, this sensing process operation is advanced to another step 
S03 . 

At this step S03, a subroutine of the highlight analyzing process 
operation is executed. In other words, as indicated in Fig. 6, the 
analyzing unit 22 analyzes the broadcast data supplied from the tuner 18 
(step S031) so as to judge as to whether or not the highlight scene is 
commenced (step S032) . At this time, the analyzing unit 22 stores a 
starting time instant of the highlight scene into the highlight index 
storage unit 25 (step S033) when this analyzing unit 22 judges that the 
highlight scene is commenced (step S032; YES) . Also, the analyzing unit 
22 stores into the highlight index storage unit 25, a recording position 
(starting address) in the buffer disk 21 as to the broadcast data, which 
corresponds to this starting time instant, and thereafter, the highlight 
analyzing process is accomplished. Subsequently, the process operation is 
advanced to a step S04 of Fig. 5. 

On the other hand, at the step S032, when the analyzing unit 22 judges 
that the highlight scene is not commenced (step S032; NO) , the analyzing 
unit 22 judges as to whether or not the highlight scene is ended (step 
S035). when the analyzing unit 22 judges that the highlight scene is not 
yet ended (step S035; NO), the highlight analyzing process operation is 
ended, and the process operation is returned to the step S04 of Fig. 5. 
To the contrary, when the analyzing unit 22 judges that the highlight 
scene is ended (step S035; YES), the analyzing unit 22 stores an end time 
instant of the highlight scene into the highlight index 
storage unit 25 

(step S036), and also stores both a recording position (end address) in 
the buffer disk 21 as to the broadcast data, which corresponds to this 
end time instant, and a length of the highlight scene into the highlight 
index storage unit 25 (step S037) . Thereafter, the highlight analyzing 
process operation is accomplished, and then the process operation is" 
advanced to the step S04 of Fig. 5. 

At the step S04, the broadcast program watching process for the 
audience is performed. In other words, the broadcast program providing 
process operation with respect to the audience is carried out. Concretely 
speaking, the broadcast data supplied from the tuner 18 is supplied to 
the decoder 8a, both the image data and the speech data contained in the 
broadcast data are decoded, or demodulated by this decoder 8a, and then, 
the image (picture) and the speech (voice) corresponding to the decoded 
image data and the decoded speech data are output from the display 
apparatus 15. Thereafter, the process operation is advanced to a step 
S05. 

At this step S05, the CPU judges as to whether or not the audience 
completes watching of the broadcast program, namely, the operation 
capable of accomplishing the process operation by the receiver 20 is 
executed. As this accomplishing operation, for example, the power supply 
of the computer 1 (receiver 20) is stopped, and the application program 
capable of realizing the receiver 20 is completed. At this time, in the 
case that the process accomplishing operation is executed, the CM start 
sensing process operation shown in Fig. 5 is ended. To the contrary, when 
the process accomplishing operation is not executed, this process 
operation is returned to the previous step SOI. 

On the other hand, at the step S06, a subroutine of the CM start index 
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storage process operation is executed by that the CM start sensing unit 
23 judges the commencement of the CM broadcast at the previous step S02 . 
In other words, as indicated in Fig. 7(A), the CM start sensing unit 23 
detects a starting time instant of this CM broadcast to store this 
detected starting time instant into the CM index storage unit 26 (step 
S061), and also stores a recording position (starting address) in the 
buffer disk 21 as to the broadcast data, which corresponds to this 
starting time instant into the CM index storage unit 26 (step S062) . 
Thereafter, the CM starting index storage process operation is completed, 
and then, the process operation is advanced to a further step S07 of Fig. 
5. 

At the step S07, a CM end sensing process operation is executed. That 
is, the CM end sensing unit 24 monitors the broadcast data so as to judge 
as to whether or not the CM broadcast is completed (step S08) . At this 
time, when the CM end sensing unit 24 judges that the CM broadcast is 
ended (step S08; YES), the process operation is advanced to a step S14 . 
To the contrary, when the CM end sensing unit 24 judges that the CM 
broadcast is not ended (step S08; NO), the process operation is advanced 
to a step S09. 

At this step S09, the reproducing management unit 27 judges as to 
whether or not the audience watches the highlight scene. In other words, 
the reproducing management unit 27 judges as to whether or not the 
broadcast data recorded on the buffer disk 21 is supplied to the decoder 
8a in the present stage. When the audience watches the highlight scene 
(step S09; YES), the process operation is advanced to a step S12, whereas 
when the audience does not watch the highlight scene (step S09; NO), the 
process operation is advanced to a step S10. 

At the step S10, a subroutine of the highlight selection process 
operation is carried out. In other words, as shown in Fig. 8, the 
reproducing management unit 27 selects proper index information from the 
index information stored in the highlight index information storage unit 
25 (step S101) . In this case, as an example, the index information is 
selected in the order of the latest starting time instant. It should also 
be noted that the index information of the highlight scene may be 
selected in accordance with an arbitrary condition. 

Thereafter, the reproducing management unit 27 seeks the read head of 
the buffer disk 21 at a starting address contained in the selected index 
information (step S102) . As a consequence, such a condition may be 
established that the reproducing operation is commenced from the starting 
address of the highlight scene. Thereafter, the highlight selection 
process operation is ended, and the process operation is advanced to a 
step Sll of Fig . 5 . 

At the step Sll, the reproducing management unit 27 switches the switch 
28 from the switch side of the tuner 18 to the switch side of the buffer 
disk 21. As a consequence, the broadcast data which are sequentially read 
out from the starting address of the highlight scene are supplied to the 
decoder 8a. Thereafter, the process operation is advanced to a step S12. 
At this step S12, both pictures (images) and speech (voice) are 
outputted from the display apparatus 15, which are produced based upon 
the broadcast data decoded by the decoder 8a. As a consequence, the 
audience can watch the highlight scene recorded on the buffer disk 21. 
Thereafter, the process operation is advanced to a step S13. 
At the step S13, similar to the above-described step S05, it is judged 
as to whether or not the audience stops watching the broadcast program. 
When the audience stops watching the broadcast program, the process 
operation of Fig. 5 is ended. To the contrary, when the audience is still 

® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



htt.n://nrint.west1awxom/d^ ,F,&dataid=B0055800000. 



1/17/2006 



Page 34 of 102 



watching the broadcast program, the process operation is returned to the 
previous step S07. 

On the other hand, in such a case that it is so judged at the step S08 
that the CM broadcast is ended and then the process operation is advanced 
to a step S14, a CM end index storage process operation is carried out. 
In' other words, as shown in Fig. 7(B), the CM end sensing unit 24 stores 
an end time instant of the CM broadcast into the CM index storage unit 26 
(step S063), and also stores into this CM index storage unit 26, both a 
storage position (end address) in the buffer disk 21 as to the broadcast 
data corresponding to this end time instant, and further, a length of 
this CM broadcast (step S064) . As a result, the CM end index storage 
process operation is accomplished, and the process operation is advanced 
to a step S15 of Fig. 5. 

At the step S15, the reproducing management unit 27 switches the switch 
28 from the switch side of the buffer disk 21 to the switch side of the 
tuner 18. This may cause such a condition that the broadcast data entered 
from the tuner 18 is supplied to the decoder 8a, so that the program 
watching mode is set. That is, the audience watches the broadcast program 
in real time. Thereafter, the process operation is advanced to the 
above-described step S03 . 

In the flow chart of Fig. 5, after the highlight analyzing process 
operation defined at the step S03 has been carried out, the program 
watching operation defined at the step S04 is executed in this order. 
Alternatively, the process sequence order of the steps S03 and S04 may be 
carried out in such an order opposite to the above -explained order. 
Also, the process operation defined at the step Sll (switching process 
operation of switch 28) may be carried out at any process steps defined 
after the commencement of the CM broadcast is sensed and up to such a 
time instant when the data corresponding to the highlight scene is 
actually commenced to be processed. Also, in the case that the switch 28 
has already been switched, no specific process operation needs to be 
performed. 

Fig. 9 is a diagram for indicating a relationship between a write 
address and a read address in the buffer disk 21 employed in the receiver 
20 according to the first embodiment. In Fig. 9, there are indicated that 
at a CM broadcast starting time instant, a starting address corresponding 
to a starting time instant of a highlight scene is sought, whereas at a 
CM broadcast ending time instant, the present address is returned to a 
position of a received broadcast program (starting address becomes 
address before being sought) . 

In Fig. 9, this relationship indicates such a case that a length of a 
highlight scene contained in a commercial broadcast 'CM1' is made longer 
than a CM broadcasting time range. In this case, when the CM broadcast is 
ended, the watching position is returned to the real-time watching 
position. 

Another commercial broadcast 1 CM2 ' shows an example where two pieces of 
highlight scenes are inserted into a single broadcasting time range. The 
highlight scenes are reproduced in the order of the latest starting time 
instant. As previously explained, when the reproducing operation of a 
certain highlight scene contained in the CM broadcast is accomplished, 
another highlight scene is selected and reproduced until the end of the 
CM broadcast is sensed. 

In accordance with the receiver 20 of this first embodiment, only such 
a data portion (broadcast data) of a broadcast program defined by a 
constant (predetermined) time duration is stored into the buffer disk 21, 
and this broadcast program is provided via the receiver 20 to an 
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audience. A highlight scene is detected from the broadcast data stored in 
this buffer disk 21, and both a starting address and an end address in 
the buffer disk 21 as to this detected highlight scene are saved. 
Thereafter, in such a case that the audience watches a broadcast 
program in real time (program watching mode) , when a CM broadcast is 
commenced, the broadcast data of the highlight scene stored in the buffer 
disk 21 is read based on both the saved starting address and the saved 
end address, and then, the read broadcast data is reproduced. As a 
result, both the picture and the speech produced based upon this 
highlight scene broadcast data are supplied to the audience (highlight 
watching mode) . Then, either a single piece or plural pieces of 
highlight scenes may be provided to the audience until the end of this CM 
broadcast is sensed. 

Thereafter, when the end of this CM broadcast is sensed, both a picture 
(image) and speech (voice) produced based on broadcast data acquired from 
the tuner 18 are provided to the audience. In other words, the present 
highlight watching mode is switched back to the program watching mode, so 
that the audience may watch the broadcast program in real time. 
As a consequence, while the CM program is being broadcasted (either CM 
broadcasting time rangewithin program or CM broadcasting time range 
between programs) , the audience can watch the highlight scenes recorded 
on the buffer disk 21. 

In accordance with the first embodiment, at the time when the CM 
broadcast is commenced, the audience can automatically watch such a 
program one more time, which has been watched so far, so that such 
useless operation as zapping operation executed while the CM program is 
broadcasted is no longer required. Also, since the highlight scene of the 
broadcast program is reproduced, it is possible to avoid such a fact that 
the audiences will lose their concentration and their interests to the 
broadcast program. Therefore, the audiences can further enjoy watching 
the program, as compared with that of the conventional broadcast 
receiver. Further, since the" highlight scenes are automatically 
reproduced, this broadcast receiver can eliminate cumbersome operations 
of replay designations by the audiences. 

(SECOND EMBODIMENT) 

Fig. 10 is a functional block diagram of a receiver 20A according to a 
second embodiment of the present invention. It should be noted that the 
receiver 20A of this second embodiment may be realized by employing the 
hardware structure (see Fig. 38) as explained in the above -explained 
first embodiment, and the functional block of Fig. 10 is substantially 
the same as that of the first embodiment, except that a highlight tag 
analyzing unit 22A (will be referred to as an 'analyzing unit 22A' 
hereinafter) is provided instead of the highlight scene analyzing unit 22 
employed in the first embodiment. 

The analyzing unit 22A interprets tag information (equal to index) 
corresponding to a highlight scene previously inserted into the broadcast 
data. In other words, while a broadcast station previously inserts 
specific tag information into a user area of broadcast data and then 
transmits the tag- inserted broadcast data, since the highlight tag 
analyzing unit 22A interprets the inserted tag from the received 
broadcast data, both a starting position and an end position of the 
highlight scene can be grasped which is designated on the side of the 
broadcast station. 

A highlight index sorts highlight scenes interpreted by tags in the 
temporal order, and a data structure of a highlight index storage unit 25 
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is similar to that of the first embodiment. 

Although operations of the receiver 20A according to the second 
embodiment are substantially equal to those of the first embodiment (see 
Fig. 5), this receiver 20A owns such a different operation in the content 
of the highlight analyzing process operation step (step S03) by the 
analyzing unit 22A. In other words, in the receiver 22A of the second 
embodiment, instead of the operations defined in the flow chart of Fig. 
6, this receiver 22A is operated in accordance with a highlight analyzing 
process operation shown in Fig. 11 according to the second embodiment. 
In Fig. 11, at a step S201, the analyzing unit 22A executes a highlight 
tag analyzing process operation and then, analyzes/ judges as to whether 
or not a tag indicative of a highlight scene is contained in broadcast 
data {step S202) . 

At this time, as a result of analysis, when the analyzing unit 22A 
detects such a tag indicative of a commencement of this highlight scene 
(step S202; YES) , this analyzing unit 22A stores as a highlight index 
into the highlight storage unit 25, both a starting time instant of the 
highlight scene corresponding to this tag and also a position (starting 
address) corresponding to this starting time instant as to the buffer 
disk 21 (steps S203 and S204) . 

Also, in the case that the analyzing unit 22A detects such a tag 
indicative of an end of the highlight scene (step S205; YES) , this 
analyzing unit 22A writes into the relevant positions of the highlight 
index storage unit 25, both an end time instant of the highlight scene 
corresponding to this tag and also a position (end address) corresponding 
to this end time instant as to the buffer disk 21 (steps S206 and S207) . 
Similar to the first embodiment, subsequently, when a CM broadcast is 
commenced, the reproducing management unit 27 may provide the highlight 
scene recorded on the buffer disk 21 to the audience instead of the CM 
broadcast, in accordance with the highlight scene index. 
In this second embodiment, while the broadcasting station previously 
multiplexes the tag information on the data of the broadcast program to 
broadcast the multiplexed broadcast data with such tag information 
functioning as the index indicative of the highlight scene, the receiver 
20A interprets this tag information to detect the highlight scene 
indicated by the tag information, and then reproduces the highlight scene 
while the CM program is broadcasted. 

Similar to the above -explained first embodiment, as a consequence, the 
audience can automatically watch such a program, which has been so far 
watched, at the time when the CM broadcast is commenced. Furthermore, the 
receiver 20A need 'not detect the highlight scene by executing the image 
recognition process operation and the speech recognition process 
operation, but also the highlight scene intentionally designated by the 
broadcast station can be supplied to the audience, so that the audience 
can enjoy watching of the broadcast program. 

(THIRD EMBODIMENT) 

Fig. 12 is a functional block diagram of a receiver 20B according to a 
third embodiment of the present invention. It should be noted that the 
receiver 20B of this third embodiment may be realized by employing the 
hardware structure (see Fig. 38) as explained in the above -explained 
first embodiment, and the functional block of Fig. 12 is substantially 
same as that of the first embodiment, except that a replay subject 
automatic judging unit 22B (will be referred to as a 'judging unit 22B' 
hereinafter) is provided instead of the highlight scene analyzing unit 
22, a replay subject index storage unit 25B is employed instead of the 
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highlight index storage unit 25, and furthermore, an input device 31 is 
newly employed. 

The input device 31 may be arranged by employing the keyboard 16 and 
the mouse 17 indicated in Fig. 38. Also, the input device 31 may be 
arranged by using a remote controller 32. Alternatively, the input device 
31 may be arranged by a microphone and a speech recognizing apparatus. 
This microphone is used to instruct the receiver 20B by a speech manner. 
In the third embodiment, the remote controller 32 is employed as this 
input device 31. Fig. 13 is a diagram for indicating an example of this 
remote ccmtroller 32. The remote controller 32 is arranged in such a way 
that a designation button 33 is provided with the conventional television 
remote controller. This designation button 33 (subject to be replayed 
later) is exclusively used to designate a replay subject. When an 
audience again wishes to watch a scene (namely, audience judges this 
scene as a highlight scene) while a broadcast program is watched, if the 
audience depresses this designation button 33, then this audience may 
watch such a scene corresponding to the designated replay subject 
(highlight scene) during the subsequent CM broadcasting time. 
In such a case that the audience designates the relay subject by using 
the input device 31 (by pressing designation button 33), the judging unit 
22B automatically judges the replay subject in accordance with this 
designation. 

For instance, the judging unit 22B sets positions as a replay subject, 
which are defined from one position corresponding to a time instant 
preceding to such a time instant when a designation is received by a 
predetermined time duration up to another position corresponding to the 
time instant when the designation is received. Alternatively, the judging 
unit 22B may set as a replay subject, a predetermined time duration 
before/after a designated time instant as a center. Also, the length of 
the replay subject may be selected to be a fixed length, or may be 
changed by the audience manipulating the input device 31. 
Then, the judging unit 22B acquires a starting time instant of the 
replay subject, a starting address thereof, an end time instant of the 
replay subject, and an end address thereof. This judging unit 22B stores 
these acquired items into the replay position index storage unit 25B. 
The replay position index storage unit 25B stores the starting time 
instant of the replay subject, the starting address thereof, the end time 
instant of the replay subject, and the end address, which are acquired by 
the judging unit 22B, in a table form for every replay subject. A data 
structure of the replay position index storage unit 25B is identical to 
that of the highlight index storage unit 25 shown in Fig. 3. 
Operations of the receiver 20B according to the third embodiment are 
substantially equal to those of the first embodiment (see Fig. 5). There 
is only such a different operation, namely a content of a highlight 
analyzing process operation (step S03) executed by the judging unit 22B. 
In other words, in accordance with the receiver 20B of this third 
embodiment, operations are executed in accordance with such a highlight 
analyzing process operation shown in Fig. 14, instead of the process 
operation of the flow chart indicated in Fig. 6. 

While a broadcast program is received, in the case that a designation 
of a replay subject from an audience is entered into the receiver 20B by 
manipulating the input device 31 (step S301; YES) , the judging unit 22B 
automatically judges the replay subject based upon a time instant when 
the designation is received (step S302) . 

Subsequently, the judging unit 22B stores both a starting time instant 
of the replay subject and also an end time instant thereof into the 
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subject index storage unit 25B (step S303), and also stores into this 
replay subject index storage unit 25B, both a starting address of this 
replay subject and an end address thereof as to the buffer disk 21 (step 
S304) . 

The subsequent operation of this receiver 20B is substantially equal to 
that of the first embodiment. In such a case that the commencement of the 
CM broadcast is detected, the reproducing management unit 27 reads out a 
proper replay subject index from the replay subject index storage unit 
25B, and then, reads out broadcast data corresponding to this read replay 
subject index from the buffer disk 21 to supply the read broadcast data 
to the decoder 8a. As a result, in the CM broadcast time range, both the 
picture and the speech, which correspond to the replay subject (highlight 
scene) designated by the audience, may be supplied instead of the CM 
broadcast program. 

Similar to the first embodiment, in accordance with the third 
embodiment, since the highlight scene is reproduced during the CM 
broadcast time, both the problem occurred while the CM program is watched 
and the problem of the zapping operation can be solved at the same time. 
Furthermore, since the replay subject wanted by the audience is 
registered as the highlight scene, the audience can more deeply enjoy 
watching the broadcast program. 

(FOURTH EMBODIMENT) 

Next, a description is made of a fourth embodiment according to the 
present invention. A receiver of this fourth embodiment owns such an 
arrangement capable of solving the below-mentioned problems. 
In the first to third embodiments, in the case that length of the 
highlight scene is longer than the length of the CM program, the 
reproducing operation of the highlight scene is automatically 
accomplished at the time instant when the end of this CM program is 
sensed, and then, the highlight scene watching mode is returned to the 
program watching mode. As a result, the first to third embodiments cannot 
satisfy such a requirement made by the audience that this audience wishes 
to continuously watch the highlight scene. 

Since both a hardware construction and a functional block of the 
receiver according to the fourth embodiment are similar to those of the 
above-explained first embodiment (see Fig. 1 and Fig. 2), explanations of 
these hardware construction/ functional block are omitted. It should be 
understood that the operation of the receiver according to the fourth 
embodiment is different from that of the first embodiment. 
Fig. 15 is a flow chart for explaining operation of the receiver 20 
according to the fourth embodiment. This receiver operation of the fourth 
embodiment is different from the receiver operation (see Fig. 5) of the 
first embodiment as follows. 

(1) The execution order of both the condition judgment (step S08) for 
judging the end of the CM broadcast and the condition judgment (step S09) 
made while the highlight scene is watched is reversed, ad compared with 
that of the first embodiment (see steps S408 and S409) . 

(2) When the end of the CM broadcast is detected (step S409; YES), the 
address of the CM end position is sought (step S415) and the present mode 
is advanced to an offset watching mode (step S404) . 

In other words, in the first embodiment, when the end of the CM 
broadcast is sensed, the highlight scene watching mode is immediately 
advanced to the program watching mode (step S04 of Fig. 5) . To the 
contrary, in the receiver of the fourth embodiment, the highlight scene 
watching mode is not advanced to the program watching mode until the 
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reproducing operation of the highlight scene is accomplished which is 
being reproduced during the CM broadcasting operation. 
As a consequence, in such a case that a length of a highlight scene 
reproduced in the CM broadcast time range is longer than this CM 

broadcast time range, when the end position of the CM broadcast is 
returned after the highlight scene has been watched, the present watching 
mode is brought into an offset watching mode delayed by preselected time 
from the program watching mode (real time watching mode) . 
Fig. 16 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the fourth embodiment. In Fig. 16, when a CM program starts to be 
broadcasted, a starting address of a highlight scene is sought and thus, 
the sought highlight scene is reproduced. 

Thereafter, in such a case that the reproducing operation of the 
highlight scene is not yet accomplished even at the time instant when the 
CM broadcast is ended, the present watching mode is returned to the CM 
end position after this highlight scene is accomplished. Thereafter, the 
offset watching mode is continued until a commencement of a next CM 
broadcast is sensed. This operation is indicated between the CM broadcast 
' CM1' and the CM broadcast ' CM2 ' shown in Fig. 16. As apparent from this 
drawing, there is a time delay from the real time watching operation. 
Similar to the program watching mode, in such a case that a 
commencement of a CM broadcast is sensed during the offset watching mode, 
a highlight scene is sought. When the highlight scene is ended, the 
present watching mode is returned to the CM end position. This fact is 
represented as a portion related to the commercial ' CM2' in Fig. 16, 
In accordance with the receiver of the fourth embodiment, when the CM 
broadcast is ended, the present watching mode is not immediately returned 
to the original broadcasting operation, but the reproducing operation is 
commenced from the CM end position of the original broadcasting operation 
after the highlight scene has been accomplished, while using the 
principle idea of the offset watching mode of the time shift watching 
operation. As a consequence, even when the length of the highlight scene 
is long, the audience can continuously watch the program without 
receiving any stress. 

(FIFTH EMBODIMENT) 

Next, a description is made of a fifth embodiment according to the 
present invention. A receiver of this fifth embodiment owns such an 
arrangement capable of solving the below-mentioned problems. 
In a television broadcasting program such as movies, for an audience to 
have a clear recognition of a movie story, a CM program is not inserted 
into this movie television broadcasting program for a preselected time 
after this broadcasting program is commenced. However, since a time 
duration required to broadcast CM programs is determined based upon a 
contract, these CM programs are concentrately broadcasted in a rear half 
portion of a broadcast program. As a result, while interests of the 
audience become emphasized in this rear half program portion, the CM 
programs are frequently broadcasted, so that this audience may feel 
strong stress while this audience watches the movie on television. 
Since both a hardware construction and a functional block of the 
receiver according to the fifth embodiment are similar to those of the 
above-explained first embodiment (see Fig. 1 and Fig. 2), explanations of 
these hardware construction/functional block are omitted. Also, similar 
to the fourth embodiment, in the receiver of this fifth embodiment, when 
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a CM broadcast is accomplished while a highlight scene is reproduced, 
after the reproducing operation of the highlight scene is ended, the 
offset watching mode is commenced (see Fig. 15). 

It should be understood that the operation of the receiver according to 
the fifth embodiment is different from that of the fourth embodiment. 
That is, the reproducing time of the highlight scene which is provided to 
the audience while the CM program is broadcasted is always made longer 
than the CM broadcasting time. As a result, in the CM broadcasting time 
range which is inserted into the rear half portion of the broadcast 
program, a time difference between a real time watching operation and an 
offset watching operation (time difference between broadcasting time 
instant and reproducing time instant in television broadcasting 
operation) may become longer than the CM broadcasting time. As a 
consequence, the audience can watch this television broadcasting program 
under such a condition that the CM broadcast is completely cut from this 
television broadcasting program. 

Fig. 17 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the fifth embodiment. In Fig. 17, when a CM program starts to be 
broadcasted, a starting address of a highlight scene is sought and thus, 
the sought highlight scene is reproduced. At this time, the present 
watching operation is returned to the end position of the CM broadcast. 
In this embodiment, the reproducing time of the highlight scene is made 
slightly longer, and this highlight scene is inserted to a front half 
portion of a broadcast program and is reproduced while a CM program is 
broadcasted. As a result, in the CM broadcasting time range which is 
inserted into a rear half portion of the broadcast program, the time 
difference between the real time watching operation and the offset 
watching operation is prolonged. As a result, in the CM broadcasting time 
range of the program rear half portion, even when the highlight scene is 
not reproduced, the CM broadcasting operation can be cut. This fact is 
indicated as a portion of a commercial program 'CM3' and a portion of a 
commercial program ■ CM4 1 indicated in Fig, 17. 

In accordance with the fifth embodiment, the length of the highlight 
scene is continuously prolonged and inserted in the CM broadcast time in 
the front half portion of the program, whereas no highlight scene is 
inserted in the CM broadcast time in the rear half portion of this 
program. As a result, as the program proceeds to the real half portion, 
the time difference between the original program broadcast and the 
actually watched scenes will become longer. This time is allocated to the 
CM broadcast time in the rear half portion of the program, and may be 
used so as to cut the CM program. 

As a consequence, in such a case that the audience watches such a 
program having a story such as movies and TV dramas on the television, 
this audience can be released from the CM programs which are frequently 
inserted into the rear half portion of the program, and therefore, can 
watch a climax portion of this program without interruptions of the CM 
programs. As a result, the audience can watch this broadcast program with 
his satisfaction. 

(SIXTH EMBODIMENT) 

Next, a description is made of a sixth embodiment according to the 
present invention. Since both a hardware construction and a functional 
block of a receiver according to the sixth embodiment are similar to 
those of the above -explained first embodiment (see Fig. 1 and Fig. 2), 
explanations of these hardware construction/functional block are omitted. 
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It should be understood that the operation of the receiver according to 
the sixth embodiment is different from that of the first embodiment as to 
such a point that a program digest is used as a highlight scene. This 
program digest implies that highlight scenes contained in a broadcast 
program, and acquired from a time instant when a preceding CM 
broadcasting time range is ended up to another time instant when a 
present CM broadcasting program is commenced {CM broadcasting time range) 
are coupled to each other without deteriorating a flow of a story. 
The program digest may be formed in such a manner that the reproducing 
management unit 27 reproduces a plurality of highlight scenes detected by 
the analyzing unit 22 in accordance with, for instance, the 
below-mentioned method. 

(1) In such a case that a plurality of highlight scenes are detected 
by the analyzing unit 22 from a program during a CM broadcasting time 
range, and the present CM broadcast is commenced, the reproducing 
management unit 27 reproduces a plurality of detected highlight scenes in 
a time sequential manner by equally increasing a reproducing speed. 

(2) While the analyzing unit 22 detects, for example, a scene where 
actors speak many lines as a plurality of highlight scenes from broadcast 
data in a program during a CM broadcasting time range, the reproducing 
management unit 27 continuously reproduces a plurality of detected 
highlight scenes when a CM broadcast is commenced. 

It should also be noted that if a content of a program during a CM 
broadcast time range is used and also a story of this program content is 
not deteriorated, then this program digest may be edited in any way. 
Fig. 18 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the sixth embodiment . In Fig. 18, a grey meshed portion indicates such a 
fact that a program digest is reproduced, and this program digest is 
related to such a program which has been broadcasted in the CM 
broadcasting time range immediately before in each of the CM broadcasting 
time ranges. 

For example, in a CM broadcasting time range of ' CM2 1 , a program digest 
is provided to an audience. This program digest is related to a content 
of a program defined from a time instant when 'CM1' is completed until 
• CM2' is commenced, which correspond to a CM broadcasting time range 
before this 1 CM2 1 . Thereafter, when the end of this CM broadcast is 
sensed, the reproduction of the program digest is ended, and then, the 
present watching mode is advanced to the program watching mode. 
In accordance with the sixth embodiment, as the highlight scene, such a 
program digest is reproduced, which is acquired for a time duration 
defined from a position where the preceding CM is inserted until the 
present CM is commenced. As a consequence, when the audience watches such 
a program having a story such as movies and dramas, this audience can 
confirm a rough outline of this story during the CM broadcasting time, 
and can again confirm the content of the program in such a case that the 
audience has not grasped the content of this story. Since the program 
digest is automatically displayed during the CM broadcasting time, this 
program digest display may give very large merits to the user. 

(SEVENTH EMBODIMENT) 

Next, a description is made of a seventh embodiment according to the 
present invention. Since both a hardware construction and a functional 
block of a receiver according to the seventh embodiment are similar to 
those of the above -explained first embodiment (see Fig. 1 and Fig. 2), 
explanations of these hardware construction/functional block are omitted. 

® 2006 Thomson/West. No Claim to Orig . U.S. Govt. Works. 



http://print,westlaw.conVdeliverv.html?dest=atD&format=HTM 



1/17/2006 



Page 42ofl02 



It should be understood that the operation of the receiver according to 
the seventh embodiment is different from that of the first embodiment as 
to such a point that a CM broadcast program portion of a CM broadcast 
program, which is temporally returned (retraced) back from a starting 
time instant of this CM broadcast program by a constant time period, is 
used as a highlight scene. 

For example, in the case that a CM broadcasting time range contained in 
a broadcast program is 2 minutes, the analyzing unit 22 detects a program 
portion of a CM broadcast program as a highlight scene, and this program 
portion is temporally returned back from a starting time instant of this 
CM broadcast program by 2 minutes. Then, the analyzing unit 22 records a 
highlight index (staring address, end address, etc.) of this highlight 
scene on the highlight index storage unit 25. Thereafter, when the 
commencement of the CM broadcast is sensed, the reproducing management 
unit 27 reproduces this program portion in accordance with the highlight 
index. 

Thereafter, when the CM end sensing unit 24 senses an end of this CM 
broadcast, the reproducing management unit 27 switches the present 
watching mode to the program watching mode. As a consequence, the 
audience can watch the broadcast program under such a condition that the 
CM broadcast program has been cut out from this program. 
Fig. 19 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the seventh embodiment. In Fig. 19, when a CM program starts to be 
broadcasted, such a fact is indicated that an address retraced for a 
length of a CM broadcasting time range is sought. 

Also, there is shown such a fact in Fig. 19, that at a time instant 
when an end of a CM broadcast is sensed, the present watching mode is 
advanced to the program watching mode, and then, an audience watches a 
program in real time. This may achieve the same effect in the case that 
the audience watches the program from which the CM broadcast is cut out. 
In accordance with the seventh embodiment, as the highlight scene, the 
CM program portion is reproduced, which is retraced from the broadcast 
program just before the CM program is commenced only by a 
previously-designated time duration. As a result, when the audience 
watches such a program having a story such as movies and dramas, the 
audience can continuously watch this program without the story being 
interrupted by the CM program, which is very useful for the audience. 

(EIGHTH EMBODIMENT) 

Next, a description is made of an eighth embodiment according to the 
present invention. Since both a hardware construction and a functional 
block of a receiver according to the eighth embodiment are substantially 
similar to those of the above-explained first embodiment (see Fig. 1 and 
Fig. 2), explanations of these hardware construction/functional block are 
omitted. It should be understood that the operation of the receiver 
according to the eighth embodiment is different from that of the first 
embodiment. That is to say, while the analyzing unit 22 applies weight 
with respect to a plurality of detected highlight scenes, the reproducing 
management unit 27 changes a reproducing speed in response to a weight of 
a highlight scene. 

Fig. 20 is an explanatory diagram for explaining a data structure of a 
highlight index storage unit 25H employed in the receiver of the eighth 
embodiment. In Fig. 20, this highlight index storage unit 25H saves 
thereinto, every highlight scene, the weighing values (importance 
degrees: in this example, any value of 1 to 10) of the highlight scenes 
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calculated by the analyzing unit 22 in addition to the starting address, 
the starting time instant, the end address, the end time instant, and the 
length of the highlight scene, which are explained in connection with the 
first embodiment. 

The analyzing unit 22 performs the weighing operation in accordance 
with the below-mentioned manner, for example. That is, in such a scene 
that a screen owns small movement, the analyzing unit 22 sets the weight 
of the highlight scene to a small weight value. The reason resides in 
that even when the screen is fed in a fast speed, since a change in the 
screens is small, the audience can easily trace the story. To the 
contrary, in such a scene that a screen owns strong movement, the 
analyzing unit 22 sets the weight of the highlight scene to a large 
weight value. The reason resides in that when the screen is fed in the 
fast speed in such a scene where the movement thereof is strong, it is 
conceivable that the audience cannot grasp the story. Also, in such a 
case that the weighting operation is carried out by way of the speech 
(voice) manner, for example, the analyzing unit 22 sets the small 
weighting value in such a scene where the actor's lines are few, whereas 
the analyzing unit 22 sets the large weighting value in such a scene 
where the actor's lines are numerous. Alternatively, the analyzing unit 
22 may set the weighing value by combing these parameters. 
Fig. 21 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the eighth embodiment. In Fig. 21, as the highlight scene to be 
reproduced in the CM broadcasting time range, the weighted scene is used. 
The highlight scene whose importance degree is low is reproduced in the 
fast feeding mode, whereas the highlight scene whose importance degree is 
high is reproduced in the slow feeding mode. 

It should also be noted that the above-described arrangement of the 
receiver of this eighth embodiment may be substituted by the 
below-mentioned arrangement. That is, as explained in the second 
embodiment, while both a tag and such data indicative of an importance 
degree may be added to broadcast data on the side of a broadcast station, 
the data indicative of the importance degree may be detected by the 
analyzing unit 22 on the side of the receiver. Alternatively, as 
explained in the third embodiment, while an audience may designate an 
importance degree by employing the input device 31, the analyzing unit 22 
may detect the designated importance degree. 

In the eighth embodiment, an image is provided to the audience, in 
which the reproducing speed is changed in response to the importance 
degree of the highlight scene. As a consequence, the audience can confirm 
the detailed portion of the important scene by way of the slow 
reproducing operation. Conversely, the audience can watch such a scene 
having a low importance degree by way of the fast -feed reproducing 
operation. Accordingly, the audience can watch the important portion in 
detail, while grasping the entire story to some extent. 

(NINTH EMBODIMENT) 

Next, a description is made of a ninth embodiment according to the 
present invention. A receiver of this ninth embodiment owns such an 
arrangement capable of solving the below-mentioned problems. 
In the case that a prize contest source of gifts is displayed to 
audiences in a broadcast program, this prize contest source is normally 
displayed only for several seconds. As a consequence, it is practically 
difficult for audiences to completely write this prize contest source on 
a memorandum and the like . As a consequence, the audiences memorize this 
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prize contest source and thereafter write the memorized prize contest 
source on paper, or several audiences try to partially memorize this 
prize contest source, and thereafter, finally construct the complete 
prize contest source. To avoid such a difficulty, one broadcast receiver 
is commercially available and is equipped with such a function that one 
frame contained in a broadcast program is captured as a still image on a 
separate window. 

However, in this type of broadcast receiver, when such a still image as 
a destination address displayed on the separate window becomes 
unnecessary, this still image must be discarded. This still picture 
discarding operation must be carried out in a manual manner. Also, since 
the still image is displayed on the separate window, this still image 
must be located on the uppermost position on the display screen, or the 
display screen must be changed. Furthermore, in such a case that the 
still image is displayed in a reducing size mode, resolution of the 
characters is decreased. There is such a drawback that these characters 
can be hardly read by the audiences . 

Since both a hardware construction and a functional block of a receiver 
according to the ninth embodiment are substantially similar to those of 
the above-explained first embodiment (see Fig. 1 and Fig. 2). It should 
be understood that the operation of the receiver according to the ninth 
embodiment is different from that of the first embodiment as to such a 
technical point that the reproducing management unit 27 provides a still 
image of one scene contained in a broadcast program as a highlight scene 
to an audience . 

Fig. 22 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the ninth embodiment. In Fig. 22, in accordance with this ninth 
embodiment, one scene within a broadcast program is displayed by a still 
image as a highlight scene which is reproduced in a CM broadcasting time 
range . When the ending of the CM broadcast is sensed, the present 
watching mode is returned to the program watching mode. 
As the still image to be reproduced, for instance, a prize contest 
source displayed in a broadcast program may be used. The scene of this 
prize contest source is detected as the highlight scene by the analyzing 
unit 22, and the reproducing management unit 27 reproduces this highlight 
scene in the CM broadcasting time range, so that the audiences can 
correctly write down the prize contest source. 

In accordance with the ninth embodiment, as the highlight scene, a 
plurality of frames (at least one frame) contained in the broadcast 
program can be utilized by scanning the frames. As a result, the 
destination address of the prize contest for the audiences, which is 
displayed in the broadcast program, can be correctly written down on 
memorandums and the like, while using the CM broadcasting time range, so 
that the audiences can effectively utilize their own time. 
It should also be noted that the method for detecting the highlight 
scene provided as the still image may be realized by employing either the 
detecting method of the second embodiment or the third embodiment. 
Alternatively, the receiver of the ninth embodiment may be equipped 
further with a means for notifying an end of a CM broadcast to audiences 
in such a case that the end of this CM broadcast is sensed. In this 
alternative case, the following selection may be made. That is, while the 
destination address is being written down, when the CM broadcast is 
completed, the still image may be continuously watched by the audiences, 
or the original broadcast program may be again watched by the audiences. 
Therefore, such concern that the audiences must write down the 
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destination address by the CM broadcast is ended may be lessened. 
(TENTH EMBODIMENT) 

Subsequently, a tenth embodiment of the present invention will now be 
described. Fig. 23 is a functional block diagram for showing a receiver 
20J according to the tenth embodiment. As indicated in Fig. 23, in the 
receiver of the tenth embodiment, a reproducing management unit 27J is 
different from the above- explained reproducing management unit 27 of the 
first embodiment. 

In other words, since this reproducing management unit 27 J switches 
speech (voice) modes when the highlight scene watching mode is selected 
and the program watching mode is selected, the reproducing management 
unit 27 J instructs the decoder 8a to switch these speech modes, if 
required. That is to say, the reproducing management unit 27 J may 
function as a speech control means of the present invention. Other 
structural elements of this receiver 20J are similar to those of the 
first embodiment, so that further explanations thereof are omitted. 
Fig. 24 is a flow chart for explaining the operation of the receiver 
20J according to the tenth embodiment. This receiver operation of the 
tenth embodiment is different from the receiver operation (see Fig. 5) of 
the first embodiment in that, the flow chart of Fig. 24 is made different 
from the flow chart shown in Fig. 5 of the first embodiment as to such a 
technical point that a speech mode switching process defined at steps 
S1012 and S1017 is interposed between the steps Sll and S12, and also 
interposed between the steps S15 and S03 . The process operations at steps 
other than the above-described steps are the same as those of the first 
embodiment. Processings in the other steps are the same as in the first 
embodiment . 

Concretely speaking, in the case that commencement of a CM broadcast is 
sensed while a broadcast program is watched (step S1002; YES) , the 
reproducing management unit 27J selects a highlight scene (step S1010) , 
and then enters both image data and speech data of the selected highlight 
scene into the decoder 8a (step S1011) . 

Furthermore, the reproducing management unit 27J applies the following 
instruction to the decoder 8a as the speech mode switching process 
operation. This instruction may switch a speech output channel from 
a 

main speech channel to a sub- speech channel (step S1012) . As a 
consequence, the speech (voice) of the highlight scene is outputted from 
the sub- speech channel. 

Thereafter, in the case that the end of the CM broadcast is sensed 
(step S1008) , the reproducing management unit 27J executes the switching 
operation from the highlight scene watching mode to the program watching 
mode (step S1016) . Subsequently, as the speech mode switching process 
operation, the reproducing management unit 27J switches the speech output 
channel from the sub- speech channel to the main speech channel (step 
S1017) . 

In the above-explained receiver example, the speech of the broadcast 
program is watched via the main speech channel in the program watching 
mode. While the speech of the broadcast program is watched via the 
sub-speech channel in the program watching mode, contrary to the above 
example in such a case that this program watching mode is changed into 
the highlight scene watching mode, this sub- speech channel is switched 
into the main speech channel. In the case that this highlight scene 
watching mode is changed into the program watching mode, the main speech 
channel is switched into the sub- speech channel. 

In accordance with the receiver 20J of the tenth embodiment, when the 
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highlight scene is reproduced, both the image of this highlight scene and 
the sub-speech (sub-voice) of this highlight scene are provided to the 
audience. As a result, in particular, when a foreign movie is played, the 
audience watches the Japanese dubbed version of this foreign movie during 
the main broadcasting program, whereas the audience may watch by the 
hero's lines in the original language version, in the highlight scene by 
utilizing the CM broadcasting time. Furthermore, while the audience 
watches the main broadcasting program in the original language, the 
audience may watch the Japanese conversion version of the highlight scene 
during the CM broadcasting time. As a result, the audience may confirm 
such a scene which could not be understood in the original language, 
which may be effectively utilized in the foreign language study using the 
foreign movies. 

(ELEVENTH EMBODIMENT) 

Next, a description is made of an eleventh embodiment according to the 
present invention. A hardware construction of a receiver according to the 
eleventh embodiment is similar to those of the above -explained first 
embodiment. Fig. 25 is a functional block for explaining a receiver 20K 
according to the eleventh embodiment. This receiver 20K owns such a 
structural difference from that of the receiver 20 (see Fig. 2) according 
to the first embodiment, that a segmental highlight scene forming unit 35 
(will be referred to as a 'forming unit 35' hereinafter) is employed 
between the analyzing unit 22 and the highlight index storage unit 25. 
The forming unit 3 5 is such a function realized by executing a computer 
program by the CPU2 . The forming unit 35 cuts and sorts highlight scenes 
detected by the analyzing unit 22 into constant lengths thereof. In other 
words, end time instants of the highlight scenes detected by the 
analyzing unit 22 are changed in such a manner that the lengths of these 
highlight scenes become constant, and addresses corresponding to the 
changed end time instants are acquired as end addresses. Then, this 
forming unit 35 stores such a highlight index related to the highlight 
scenes whose lengths are cut and sorted into the highlight index storage 
unit 25. 

As a constant length, for example, a single CM program is normally 
formed by a time duration of 15 seconds, or multiplication values thereof 
(15 seconds, 30 seconds, 1 minute) . A single CM broadcasting time range 
is constituted by combining a plurality of CM programs, and therefore, 
may have a length of either 1 minute or 2 minutes. To this end, the 
forming unit 35 cuts and sorts the highlight scenes in the unit of 15 
seconds. Otherwise, since there are many cases that a one -spot CM program 
is broadcasted in the unit of 1 minute, the forming unit 35 forms the 
highlight scenes in the segment of 1 minute. 

As a consequence, the highlight scenes whose lengths are made 
coincident with the length of the CM program can be reproduced while one 
CM broadcasting program is broadcasted which is made coincident with 
either a length of a single CM program or a length of plural CM programs, 
which are broadcasted within one CM broadcasting time range. As a result, 
a time instant when the CM broadcast is ended can be made coincident with 
another time instant when the reproduction of the highlight scene is 
ended . 

In accordance with the receiver of the eleventh embodiment, since a 
length of a single CM program is essentially determined by a preselected 
value, the CM program is formed coincident with the length of the 
highlight scene CM, so that the highlight scene may be reproduced only 
during the CM broadcasting time. In other words, since the forming unit 
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35 forms the length of the highlight scene in the unit of 1 minute, in 
such a case that the length of the CM broadcasting time range is 
increased or decreased in the unit of 1 minute, the highlight scene can 
be just inserted into this CM broadcasting time range. As a consequence, 
the audience can completely watch the highlight scene instead of the CM 
program. 

(TWELFTH EMBODIMENT) 

Next, a description will now be made of a twelfth embodiment of the 
present invention. A construction of a receiver according to the twelfth 
embodiment is substantially the same as that of the first embodiment (see 
Fig. 1), Fig. 26 is a functional block of a receiver 20L according to the 
twelfth embodiment. 

It should be understood that since the receiver 20L is similar to the 
receiver 20 of the first embodiment except for the below-mentioned 
technical aspect, common technical aspects thereof are omitted. 
(12-1): A highlight scene classifying unit 36 (will be referred to as 
'classifying unit 36' hereinafter) is provided between the analyzing unit 
22 and a highlight index storage unit 25L. 

(12-2) : The input device 37 is provided outside the receiver 20L, and 
also both a user taste registering unit 38 and a user taste database 39 
are provided inside the receiver 20L. 

The classifying unit 36 corresponds to such a function realized by 
executing a computer program by the CPU 2 . The classifying unit 36 
classifies a highlight scene detected by the analyzing unit 22 into any 
one of the plurality of genres. A genre indicates an attribute of a 
highlight scene, for instance, this attribute represents a nature scene, 
an action scene, a love scene, and the like. 

Similar to the analyzing unit 22, the classifying unit 36 may classify 
a highlight scene in accordance with a previously saved classification 
condition, by using a speech recognition of this highlight scene, an 
image recognition thereof, and a combination of these speech/image 
recognitions. The classification condition may be defined in accordance 
with a screen element contained in a scene, and a trend (directivity) of 
a speech. 

For example, when the classified genre is a natural scene, since there 
is a small number of screen elements constituted by straight lines, in 
such a case that the straight line components of the screen elements of 
the highlight scene are smaller than or equal to a preselected value, the 
classifying unit 36 judges the relevant highlight scene as the natural 
scene, and then classifies this highlight scene into such a genre 
corresponding to the natural scene. 

Also, when the classified genre is an action scene, the following trend 
may exist. That is, an object greatly moves around, and BGM and effective 
sounds become active and strong. As a consequence, in such a case that 
screen elements and sounds of a highlight scene are made coincident with 
the above -explained trend, the classifying unit 36 judges this highlight 
scene as the action scene. 

Furthermore, generally speaking, a love scene is constituted by two 
persons. There is such a trend that voices of these persons are low, and 
BGM such as a ballad is used. As a result, when screen elements of a 
highlight scene is made coincident with this trend, the classifying unit 

36 judges this highlight scene as the love scene. 

It should be noted that the present invention is not limited to the 
above- explained example, but may be applied to the following case. That 
is, when the classification condition is determined in accordance with a 
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trend (directivity) responding to an attribute of a specific genre, a 
highlight scene may be furthermore classified into a plurality of genres. 

For instance, while voice of a specific actor and a talent are sampled, 
if a highlight scene contains such voice coincident with the sampled 
voice, then only such a scene that either a specific actor or a talent 
appears may be collected. 

Then, the classifying unit 36 allocates a numeral value indicative of a 
genre to a highlight scene in accordance with a classification result of 
this highlight scene, and stores this numeral value into the highlight 
index storage unit 25L as one of the elements of highlight indexes. 
Fig. 27 is an explanatory diagram for explaining a data structure of a 
highlight index storage unit 25L employed in the receiver of the twelfth 
embodiment. As shown in Fig. 27, this highlight index storage unit 25L 
saves thereinto the numeral values (in this example, any one of 1 to 10) 
indicative of the genres of the highlight scenes in addition to the 
starting address, the starting time instant, the end address, the end 
time instant, and the length of the highlight scene (see Fig. 3) , which 
are explained in connection with the first embodiment. 
The input device 3 7 may be arranged by the pointing device such as the 
keyboard 16 and the mouse 17, a remote controller, or a microphone for 
processing a speech recognition of an audience and a speech recognizing 
apparatus. The input device 37 may be used so as to register own tastes 
of the audiences (users) . Concretely speaking, an audience inputs a 
numeral value indicative of the own degree of taste with respect to each 
of previously-prepared genres by employing the input device 37, 
The user taste registering unit 38 corresponds to such a function 
realized by executing a computer program by the CPU 2. When the degree of 
taste is entered from the input device 37, the user taste registering 
unit 38 registers this inputted degree of taste into the user taste 
database 39. 

Fig. 28 is an explanatory diagram for explaining a data structure of 
the user taste database 39. As indicated in Fig. 28, the user taste 
database 3 9 owns such data items as to genres of highlight scenes, and 
also the degrees of taste of audiences corresponding to these genres. In 
this database, the larger the numeral value the degree of taste, the 
higher the taste characteristic. 

It should be noted that in this example, only the table with respect to 
one audience is indicated. Alternatively, while plural sets of such 
tables shown in Fig. 28 are provided, the degrees of taste of plural 
audiences may be registered into these tables. 

A reproducing management unit 27L manages reproducing operations of the 
highlight scenes recorded on the buffer disk 21 based upon the CM index, 
the highlight index, and also the content saved in the user taste 
database 39. 

Operations of the receiver 20L according to the twelfth embodiment is 
substantially the same as those of the receiver according to the first 
embodiment, shown in Fig. 5. It should also be noted that the operations 
of a highlight selection process operation defined in a step S10 is 
different from that of the first embodiment. That is, in the twelfth 
embodiment, the below-mentioned operation is carried out at the step S10. 

The reproducing management unit 27L sequentially selects and reproduces 
such highlight scenes which may agree to the taste of the audience from a 
plurality of highlight scenes as a highlight scene to be reproduced while 
a CM program is broadcasted. 
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In other words, the reproducing management unit 27L recognizes the 
degrees of taste with respect to the respective genres of the audiences 
with reference to the user taste database 39. Subsequently, the 
reproducing management unit 27L sequentially selects and reproduces such 
highlight scenes of genres in which the degrees of taste of the users are 
high with reference to the highlight index storage unit 25L. As a result, 
the highlight scenes in which the degree of taste of the user is high are 
reproduced with top priority among a plurality of highlight scenes. 
As a consequence, the audience of the broadcast program can watch the 
highlight scenes in the CM broadcasting time range in the order of the 
own desirable taste. 

In accordance with the receiver of the twelfth embodiment, when the 
degrees of taste of the audiences are previously registered, the 
highlight scenes are reproduced in the order of the degrees of taste 
thereof. In other words, in accordance with the twelfth embodiment, the 
highlight scenes can be provided with the audiences in response to the 
tastes which are defined based on the attributes (sex, age, character, 
etc.) of the audience. Therefore, the audiences can have the satisfactory 
feelings made by watching the highlight scenes over a wide range. 

{THIRTEENTH EMBODIMENT) 

Next, a description will now be made of a thirteenth embodiment of the 
present invention. A construction of a hardware according to the 
thirteenth embodiment is substantially the same as that of the first 
embodiment (see Fig. 1) . Fig. 29 is a functional block of a receiver 20M 
according to the thirteenth embodiment. 

It should be understood that since the receiver 20M is similar to the 
receiver 20 of the first embodiment except for the below-mentioned 
technical aspect, common technical aspects thereof are omitted. 
(13-1) : No switch 28 is employed. A decoder 8b into which only 
broadcast data derived from the tuner 18 is entered is connected in 
parallel to another decoder 8c into which only broadcast data derived 
from the buffer disk 21 is entered. 

(13-2) : A plural screen display unit 41 (equal to display control 
unit) is employed which is connected to the respective decoders 8b and 
8c, and furthermore, to the display apparatus 15. 

(13-3) : A reproducing management unit 27M controls operation of the 
plural screen display unit 41. 

Fig. 30 is a flow chart for indicating operations of the receiver 20M 
according to the thirteenth embodiment. The flow chart of Fig. 30 owns 
such a different step, instead of the process operations defined at the 
steps Sll and S15 in the flow chart of the first embodiment (shown in 
Fig. 5), a plural screen display process operation (step S1312) is 
executed instead of the step Sll, and also a single screen display 
process (step S1317) is executed instead of the step S15. The process 
operations other than those of the above-explained steps are the same as 
those of the first embodiment. 

Concretely speaking, since the receiver 20M of the thirteenth 
embodiment employs the arrangement of Fig. 29, the broadcast data 
supplied from the tuner 18 is always inputted into the decoder 8b while 
the audience watches the broadcast program, when the commencement of the 
CM broadcast is sensed (step S1302) , the reproducing management unit 27M 
instructs the plural screen display unit 41 in such a manner that both 
the broadcasting screen of the program and the screen of the highlight 
scene are displayed at the same time on the monitor of the display 
apparatus 15 (step S131-1) . 
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On the other hand, when the end of the CM broadcast is sensed (step 
S1308), the reproducing management unit 27M instructs the plural screen 
display unit 41 in such a manner that only the broadcast screen of the 
program is displayed on the monitor of the display apparatus 15 (step 
S1315) . In this way, the audience is able to watch the highlight scene on 
a plural screen display during the CM broadcast time range, and when the 
CM broadcast time range ends, to watch the subsequent program on a single 
screen display. 

Fig. 31 illustratively shows an example of a screen display image of 
the receiver according to the thirteenth embodiment, in Fig, 31, 4 
pattern examples 'A' to 'D' are displayed as a pattern example of a 
plural screen display in a CM broadcasting time range. It should be noted 
that if the plural screen display is realized, then other pattern 
examples than the above- explained patterns 'A' to 'D' may be employed. 
The pattern example 'A' corresponds to such a display pattern that a 
screen of a highlight scene (highlight screen) is displayed in a 
full-sized screen, and a screen received in real time (received broadcast 
screen) is overlapped on this highlight screen located at a lower right 
corner in a small screen display. 

The pattern example 'B f and the pattern example ' C correspond to such 
a pattern example that the highlight screen is not overlapped with the 
received broadcast screen. The pattern example 1 B* is featured by that 
the size of the highlight screen is larger than the size of the received 
broadcast screen. The pattern example • C is featured by that the size of 
the highlight screen is equal to the size of the received broadcast 
screen . 

In accordance with the receiver of the thirteenth embodiment, both the 
highlight screen and the received broadcast screen of the CM broadcast 
are simultaneously displayed on the display apparatus 15 while the CM 
broadcast is carried out. As a result, the audience can watch the 
highlight scene at the same time as when the audience watches the 
received broadcast screen of the CM broadcast. As a consequence, this 
receiver can meet such a requirement of the audience, that although the 
audience wishes to watch only a popular CM program and a CM program in 
which a favorite talent appears, the audience does not wish to watch 
other CM programs than the above-explained CM programs. 
It should also be noted that the highlight scene reproduced in the 
thirteenth embodiment may be acquired by way of the method of the second 
or the third embodiment. 

(FOURTEENTH EMBODIMENT) 

Next, a description will now be made of a fourteenth embodiment of the 
present invention. A construction of a hardware according to the 
fourteenth embodiment is substantially the same as that of the first 
embodiment (see Fig. l) . A functional block of a receiver 20M according 
to this fourteenth embodiment is similar to that of the thirteenth 
embodiment (see Fig. 29) . 

It should be noted that operations of the receiver of the fourteenth 
embodiment are different from those of the thirteenth embodiment. In 
other words, in the fourteenth embodiment, in such a case that both a 
highlight scene and a CM broadcast are displayed in a plural screen 
display mode, when the CM broadcast is ended, the plural screen display 
mode (display mode) is changed. Thereafter, when the reproduction of the 
highlight scene is ended, the display mode is advanced to the single 
screen display of the received broadcast screen. 

Fig. 32 is a flow chart for describing operations of the receiver 20M 
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according to the fourteenth embodiment. Referring now to Fig. 32, a major 
operation of this receiver 20M will be explained. 

At a step S1402, the CM start sensing unit 23 analyzes the broadcast 
data received from the tuner 18 so as to judge whether or not the CM 
broadcast is commenced. At this time, when the CM broadcast is not yet 
commenced (step S1402; NO) , a highlight analyzing process operation (step 
S1403: see Fig. 6) is carried out, and thereafter, the audience watches 
the broadcast program (step S1404) . It should also be noted that the 
processing order of the steps S1403 and S1404 may be reversed. 
Thereafter, when the audience continues to watch the broadcast program 
(step S1405; NO), the process is returned to the step S1401. 
On the other hand, in the case that the CM start sensing unit 23 senses 
the start of the CM broadcast (step S1402; YES), a CM start index storage 
process operation is executed (step S1406: see Fig. 7(A)). Thereafter, 
the reproducing operation of the highlight scene is carried out until the 
end of the CM broadcast is sensed in a CM end sensing process operation 
(S1407) . 

That is to say, a highlight selection process operation is executed if 
required (step S1410: see Fig. 8). A first plural screen display process 
operation (step S1411) is carried out which is similar to the plural 
screen display process operation (step S1311) of the thirteenth 
embodiment. As a result, the audience can watch the highlight scene in 
the plural screen display mode (step S1412) . 

Thereafter, when the CM end sensing process (step S1407) is carried 
out, if the reproducing operation of the highlight scene (step S1408; NO) 
and also the CM broadcast is accomplished (step S1409; YES) , then a CM 
end index storage process operation (step S1416: see Fig. 7(B)) is 
executed. Thereafter, the single screen display process operation similar 
to that of the thirteenth embodiment is carried out (step S1417) , and the 
present watching mode is advanced to the program watching mode (step 
S1404) . 

On the other hand, when the CM end sensing process operation (step 
S1407) is executed, in such a case that the reproducing operation of the 
highlight scene is not yet ended (in case of highlight watching mode) 
(step S1408; YES), a check is made as to whether or not the CM broadcast 
is ended (step S1414) . 

At this time, when the CM broadcast is not yet ended (step S1414; NO), 
the process is advanced to a further step S1412. At this step S1412, the 
reproducing operation/plural screen display operation of the highlight 
scene are continued. To the contrary, in the case that the CM broadcast 
is ended while the audience watches the highlight scene (step S1414; 
YES), a second plural screen display process operation (step S1415) is 
carried out, and the display pattern of the plural screen display is 
changed. Thereafter, the process operation is advanced to a step S1412. 
Fig. 33 is an explanatory diagram for explaining a screen display 
example obtained in connection with the operations of the receiver of the 
fourteenth embodiment, in Fig. 33, there are three pattern examples Al, 
Bl, and CI. As indicated in Fig. 33, before the CM broadcast is 
commenced, the received broadcast screen is displayed in the single 
screen display mode. Thereafter, when the CM broadcast is commenced, the 
first plural screen display operation is carried out. In the first plural 
screen display operation, both the highlight screen and the received 
broadcast screen of the CM broadcast are displayed on the monitor at the 
same time. On the respective screens, sizes of screens and ordering of 
display positions are previously given. 

In other words, both the pattern examples Al and Bl are such pattern 
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examples that the orders of the highlight screens are high in view of 
screen sizes, and the sizes of the highlight screens are larger than the 
sizes of the received broadcast screens. To the contrary, the pattern 
example Cl corresponds to such a pattern example that the order of the 
received broadcast screen of the CM broadcast is high in view of the 
display position, and the received broadcast screen is displayed in front 
of the highlight screen. 

In such a case that the CM broadcast is accomplished while the audience 
watches the highlight scene, the display mode is changed into the second 
plural screen display mode under control of the plural screen display 
unit 41 by the reproducing management unit 27M. This display mode change 
is carried out by reversing, for example, the order in the first plural 
screen display operation. 

Pattern examples A'l, B'l, and Cl shown in Fig. 33 and corresponding 
to the example of the second plural screen display are such pattern 
example obtained by reversing the ordering of the first plural screen 
display, in which the highlight screen is substituted by the received 
broadcast screen of the program. Thereafter, at a time instant when the 
audience ends watching 

the highlight screen, the present screen display 

operation is returned to the original single screen display operation of 
the received broadcast screen. 

In accordance with the receiver of the fourteenth embodiment, even when 
the CM broadcast is ended, since the plural screen display operation is 
executed, the audience can watch the highlight scene and the broadcast 
program at the same time even after the CM broadcast is ended, and 
therefore, it is possible to prevent such watching of the highlight scene 
half way. 

Also, the ordering are previously given to both the sizes and the 
display positions as to the highlight screen and the received broadcast 
screen in the plural screen display operation. While the CM program is 
broadcasted, the order of the highlight screen is set to the high order, 
whereas the order of the received broadcast screen is set to the high 
order after the CM broadcast is ended. 

As a consequence, while one audience who wishes to watch the broadcast 
program in real time is treated with a top priority, a requirement of 
another audience who wishes to completely watch a highlight scene can be 
met in the receiver of this fourteenth embodiment. It should also be 
noted that the ordering operation as to the highlight screen and the 
received broadcast screen may be made opposite to that of the 
above-explained example by manipulation from the audience. 

(FIFTEENTH EMBODIMENT) 

Next, a description will now be made of a fifteenth embodiment of the 
present invention. A construction of a receiver according to the 
fifteenth embodiment may be realized by employing a similar construction 
of the first embodiment (see Fig. 1) . Fig. 34 is a functional block 
diagram of a receiver 20N according to this fifteenth embodiment. The 
receiver 20N is arranged by adding an input device 42, an index screen 
display unit 44, a highlight scene instructing unit 43, and a switch 45 
to the structural elements (see Fig. 2) of the first embodiment. 
The index screen display unit 44 is such a function realized by 
executing a computer program by the CPU 2 . The index screen display unit 
44 reads a starting address of each highlight scene stored in the 
highlight index storage unit 25, reads a first scene of a highlight scene 
stored at this starting address from the buffer disk 21, and then, forms 
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a still image indicative of the first scene of the highlight scene. 
Then, the index screen display unit 44 saves the formed still image as 
an index, and outputs this saved index to the display apparatus 15. At 
this time, in such a case that the switch 45 is brought into such a 
switching state that the index screen display unit 44 is connected to the 
display apparatus 15, a still image of a single highlight scene, or still 
images of plural highlight scenes are displayed as an index screen (see 
Fig. 36) on the monitor of the display apparatus 15. 

The input device 42 may be arranged by the pointing device such as the 
keyboard 16 and the mouse 17, a remote controller, or a microphone for 
processing a speech recognition of an audience and a speech recognizing 
apparatus. The input device 42 may be used so as to select a desirable 
highlight scene, while the audience refers to the index screen. 
The highlight scene instructing unit 43 is such a function realized by 
executing a computer program by the CPU 2. The highlight scene 
instructing unit 43 is initiated in such a case that the CM start sensing 
unit 23 senses the commencement of the CM broadcast. Then, the highlight 
scene instructing unit 43 switches the switch 45 to the switch side of 
the index screen display unit 44 so as to display an index screen on the 
display apparatus 15. 

Thereafter, when a designation of a highlight scene is entered from the 
input device 42, the highlight scene instructing unit 43 controls the 
reproducing management unit 27N in order that this highlight scene is 
displayed on the display apparatus 15, and also switches the switch 45 to 
the side of the decoder 8a. 

The reproducing management unit 27N receives the reproduction 
instruction of the highlight scene designated by the input device 42 .from 
the highlight scene instruction unit 43. As a result, the reproducing 
management unit 27N inputs such broadcast data corresponding to the 
designated highlight scene into the decoder 8a in accordance with this 
reproduction instruction by way of the manner as explained in the first 
embodiment. As a consequence, the designated highlight scene is displayed 
on the monitor of the display apparatus 15. 

The switch 45 owns a structure substantially equal to that of the 
switch 28. The highlight scene instructing unit 43 causes the switch 45 
to be switched to any one switch side between the decoder 8a and the 
index screen display unit 44. 

Fig. 35 is a flow chart for describing process operations of the 
receiver 20N according to the 15th embodiment in the case that the 
receiver 20N receives broadcast data. Referring now to this flow chart of 
Fig. 35, a major operation executed in this receiver 20N will now be 
described. 

At a step S1502 of Fig. 35, when it is so judged that a CM broadcast is 
not yet commenced, a highlight analyzing process operation (step S1503: 
see Fig. 6) is executed, and thereafter, an audience watches a broadcast 
program (step S1504) . It should be understood that the process sequence 
of the steps S1503 and S1504 may be reversed, as compared with the 
above- explained process sequence. Next, when the audience continues to 
watch the broadcast program (step S1505; NO), this process operation is 
returned to the step S1501. 

On the other hand, in such a case that a commencement of a CM broadcast 
is sensed (step S1502; YES), a CM start index storage process operation 
is carried out (step S1506; see Fig. 7(A)). Thereafter, an index screen 
display process operation is executed (step S1507) . That is, an index 
screen is displayed on the display apparatus 15 by both the highlight 
scene instructing unit 43 and the index screen display unit 44. 
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when the index screen is displayed, this index screen is kept displayed 
until the audience (user) designates a highlight scene by manipulating 
the input device 42, or the CM broadcasting time range is ended (namely, 
loop process defined by steps S1507, S1508, and S516) . 
while the index screen is displayed, in the case that the audience 
designates (selects) the highlight scene (step S1508; YES) , the 
designated highlight scene is reproduced by the reproducing management 
unit 27N until the end of the CM broadcast is sensed at the step S1509 
(namely, loop process defined by steps S1509 to S1515) . It should be 
noted that in Fig. 35, both the end sensing process operation (step S07 
of Fig. 5) and the condition judging operation (step SOS of Fig. 5) are 
integrated with each other as steps S1509 and S1516. 

In the loop process operation defined by the steps S1509 to S1515, when 
the highlight scene is not yet selected (step S1510; NO) , a highlight 
selecting process operation is executed, and then, the designated 
highlight scene is selected (step S1511: see Fig. 8). 
Thereafter, the switch 45 is switched from the broadcast data derived 
from the tuner 18 for the decoder 8a into the data derived from the 
buffer disk 21 (step 1512), and the screen display mode is returned from 
the index image display mode to the normal screen display mode in order 
that the audience watches the highlight scene (steps S1513 and S1514) . 
Thereafter, in the case that the end of the CM broadcast is sensed 
(step S1509; YES), a CM end index storage process operation (step 1517: 
see Fig. 7(B)) is carried out. Next, in the case that the index screen is 
displayed on the display apparatus 15, the index screen is switched to 
the normal screen (step S1518) , and the switch 45 is switched from the 
broadcast data derived from the buffer disk 21 for the decoder 8a to the 
data derived from the tuner 18 (step S1519) , and then, the present 
watching mode is advanced to the program watching mode (steps S1503 and 
S1504) . 

Fig. 36 illustratively shows a screen display image of the monitor 
according to the 15th embodiment. As indicated in Fig. 36, just before 
the CM broadcast is commenced, the normal screen is displayed on the 
monitor. When the commencement of the CM broadcast is sensed, the normal 
screen is switched into an index screen. The index screen displays as an 
index, a still image of a head screen of such a highlight scene which is 
formed in the index screen display unit 44 (corresponding to index 
providing unit), and is selectable. The indexes are displayed on 
subdivided areas, for instance, which are produced by equally dividing 
the display area of the monitor. 

While the audience refers to the indexes (still images) displayed on 
the index screen, if a desirable highlight scene is present, then the 
audience designates (selects) this desirable highlight scene by operating 
the input device 42. As a consequence, the index screen is switched to 
the normal screen, and thus, the selected highlight scene is displayed. 
In Fig. 36, symbols 'HA' and 'HB' correspond to the selected highlight 
scene . 

To the contrary, as indicated in Fig. 36, an index of a received 
broadcast program which is selected when the audience wants to watch the 
CM program, or when the audience does not want to watch the highlight 
scene may be contained in the index screen. 

As the index of the received broadcast, for instance, either a still 
image of a broadcast program appeared just before a CM broadcast is 
started, or another still image of the broadcast program appeared just 
after the CM broadcast is commenced may be formed by the index screen 
display unit 44 to be displayed. Alternatively, such a button used to 
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select the received broadcast may be displayed as an index of this 
received broadcast. 

In the case that the index of the received broadcast is selected, the 
switch 28 is switched to the side of the tuner 18, and also the switch 45 
is switched to the side of the decoder 8a. As a result, the index screen 
is switched to the normal screen, and the CM broadcast is displayed on 
the monitor. In other words, the CM program may be provided with the 
audience in real time. Thereafter, when the CM broadcast is ended, the 
broadcast program may be continuously provided with the audience. 
In accordance with the 15th embodiment, while the index screen of the 
highlight scene is displayed, when the audience selects a desirable 
highlight scene, this selected desirable highlight scene is reproduced. 
As a result, since the audience can watch the desirable highlight scene, 
the CM broadcasting time range can be more effectively utilized, as 
compared with that of other embodiments. Also, in such a case that such a 
desirable highlight scene is not contained in the index screen, the 
audience may watch the CM broadcast by selection on watching of the 
received broadcast. 

It should be noted that in the 15th embodiment, the still image is 
employed as the index of the highlight scene. This index may be realized 
by such a text indicative of a content of the highlight scene. Also, as 
indicated in Fig. 36, the index screen is not displayed on the area 
obtained by equally subdividing the index, but may be displayed in a list 
form. 

In the flow chart shown in Fig. 35, in such a case that the length of 
the selected highlight scene is shorter than the CM broadcasting time 
range, after the reproducing operation of the selected highlight scene 
has been completed, the selected highlight scene is reproduced by the 
reproducing management unit 27 until the CM broadcasting time range is 
ended. To the contrary, in the case that the reproducing operation of the 
selected highlight scene is accomplished before the CM broadcasting time 
range is ended, the index screen may be displayed again. 

(16TH EMBODIMENT) 

Next, a description will now be made of a 16th embodiment of the 
present invention. A construction of a receiver according to the 16th 
embodiment is substantially same as that of the sixth embodiment (see 
Fig. 1). It should be understood that in the receiver of the 16th 
embodiment, a digest of the broadcast program which has been so far 
watched by an audience is reproduced after one broadcast program has been 
ended until another broadcast program subsequent to the above-mentioned 
broadcast program is commenced. 

A recognition of a program end and a program start is carried out in 
accordance with the below-mentioned manner. That is, for instance, there 
is such a service that program information (broadcast program: 
•electronic program list') is provided via the Internet and the like. The 
data related to a starting time instant and also an end time instant of a 
program are acquired by utilizing this service. Then, both the program 
end time instant and the program starting time instant can be recognized 
by using these data. An electronic program list is referred to as an ' EPG 
(Electronic Program Guide) and is contained in broadcast 
electromagnetic waves in the BS digital broadcasting system. 
Alternatively, an audience may manually input a broadcast program 
(program starting time instant and program end time instant) into the 
receiver . 

In such a case that a broadcast program is arranged by entering 

® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



httD://Drint.westlaw.com^ 1/17/2006 



Page 56 of 102 



combined CM programs after this broadcast program is accomplished, if 
total time of the CM programs is counted from a starting time instant of 
this broadcast program, since a CM insertion ratio with respect to the 
broadcast program is determined. Accordingly; a time duration of the CM 
programs which are inserted into the broadcast program after this program 
is ended until the next program is commenced can be calculated backward . 
The digest may be formed by coupling the program digests which are 
explained in the sixth embodiment. In such a case that the length of the 
digest is desired to be adjusted to be equal to the time duration up to 
the next program, for example, as previously explained in the eighth 
embodiment, the following length adjusting method may be employed. That 
is, while the importance degrees are allocated to the respective program 
digests, the program digests having the higher importance degrees are 
sequentially selected, and the selected program digests are coupled to 
each other. As a result, the length of the coupled program digests is 
adjusted in such a manner that the length of the digest is made equal to 
the length of the CM broadcasting time range between the two continuous 
broadcast programs . 

Fig. 37 is a diagram for indicating a relationship between a write 
address and a read address to a buffer disk in the receiver of the 16th 
embodiment. In Fig. 37, during from when a program 'A' is accomplished 
until a program 'B' is commenced, a digest of the program 'A' which has 
been so far watched is reproduced. At a time instant when the 
commencement of the program 'B' is sensed, the present watching mode is 
returned to the program watching mode. 

In accordance with the 16th embodiment, in the CM broadcasting time 
range between the two continuous programs, the digest of the broadcast 
program, which has been broadcasted just before this CM broadcasting time 
range, is reproduced. As a result, the audience can watch the digest of 
such a broadcast program which has been watched after one broadcast 
program is ended and until the next broadcast program is commenced. 
As a consequence, the audience can take another look as to feelings of 
the program. For example, when the audience is impressed with the 
broadcast program, this audience can be deeply impressed with this 
broadcast program by watching the digest of this program. Otherwise, by 
watching the digest of the program, the audience can furthermore have a 
deep understanding of the story of the program, and thus, this audience 
may have other feelings different from the feelings with respect to this 
broadcast . 

It should be understood that the CM end sensing unit 24 for sensing the 
end of the CM broadcast is employed in the above-explained first to 16th 
embodiments. Instead of this CM end sensing unit 24, a time measuring 
unit (timer) may be employed. This time measuring unit is operated as 
follows, when a predetermined time duration has passed after a 
commencement of a CM broadcast is sensed, the present watching mode is 
automatically transferred to the program watching mode. When such a time 
measuring unit is employed, the arrangement of the receiver can be made 
simpler. Moreover, if the CM broadcasting time range is previously 
grasped, then the CM programs can be completely cut. 
It should also be noted that the arrangements of the receivers as 
explained in the first to 16th embodiments may be properly combined with 
each other. 

In the broadcast receiver, the broadcast control method, and the 
recording medium for recording thereon the computer program, according to 
the present invention, the audience need not perform the zapping 
operation. Therefore, it is possible to avoid such a problem that the 

® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



httD://nrint.west1aw.oom^ 



1/17/2006 



Page 57 of 102 



audience may loose his interests as to the broadcast program even in the 
CM broadcasting time range contained in this broadcast program. 
This invention being thus described, it will be obvious that same may 
be varied in various ways. Such variations are not to be regarded as 
departure from the scope of the invention, and all such modifications 
would be obvious for one skilled in the art intended to be included 
within the scope of the following claims. 

SPECIFICATION EP 1158791 Bl 

The present invention generally relates to a broadcast receiver, a 
broadcast control method, and a computer readable recording medium. More 
specifically, the present invention is directed to a broadcast receiver 
and a broadcast control method, which are capable of effectively 
utilizing CM broadcasting time (commercial broadcasting time) within a 
broadcasting program, and also directed to a recording medium for 
recording thereon a computer readable program used to execute the 
broadcast control method. 

Very recently, various sorts of broadcasting networks appear in 
addition to the normally available television broadcasting system using 
the ground waves, known as cable television broadcasting systems and 
BS/CS satellite broadcasting systems using satellites. As a result, 
possibilities capable of selecting desirable programs are increased with 
respect to audiences. Also, the analog TV broadcasting systems such as 
the presently available ground wave TV broadcasting system will be 
replaced by the digital TV broadcasting systems such as the CS 
broadcasting system. Both the BS broadcasting systems and the ground wave 
broadcasting systems are decided to be replaced by the digital TV 
broadcasting systems in near future. 

In near future, a watching style called as a 'time shift watching 
(listening/viewing) style' may be executed to constitute a 
general -purpose watching style, since low cost and large capacities of 
random-accessible storage media (e.g., hard disks) may be greatly 
realized, and further, the analog broadcasting systems are substituted by 
digital broadcasting systems. 

The time shift watching style implies such a style that random access 
media constituted in a logically-ring-shaped form is prepared as a buffer 
for temporarily storing thereinto reception data, and an audience watches 
a broadcast program while broadcast data received when the broadcast 
program is received is temporarily stored into the random access media. 
Since broadcast program data corresponding to the storage capacities of 
the random access media are saved therein, trick plays such as seek, 
pause, and replay operations may be realized at arbitrary timing within a 
watching broadcasting program by accessing this program data at random. 
In receivers capable of realizing the time shift watching style, 
audiences may repeatedly view so-far-missed scenes. Also, even in such a 
case that a telephone call is made while an audience watches a broadcast 
program and/or a visitor suddenly comes so that the audience leaves from 
the present location to another location, if the present time is defined 
within a remaining storage capacity of random access media, then the 
audience may temporarily stop watching of the program, and after the 
audience finishes the subject matter, the audience again may restart 
watching the interrupted program content . 

Japanese Patent Application Laid-open No. Hei 6-14274 discloses the 
technique of the television receiver capable of realizing the time shift 
watching style, and also Japanese Patent Application Laid-open Hei 
7-264529 describes the technique of such an apparatus capable of 
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realizing the time shift watching style. 

Fig. 38 is a diagram for representing a relationship between address 
positions and reproducing time of writing operation and reading operation 
with respect to a disk which is used as a buffer (will be referred to as 
a 'buffer disk') when the time shift watching style is performed. 
Since a broadcast receiver receives broadcast data in a constant bit 
rate, a data writing rate with respect to a buffer disk is constant. As a 
result, as indicated by a dotted line in Fig. 38, a relationship between 
time and an address during writing operation becomes a straight line. 
Accordingly, since broadcast data is read out from the buffer disk at the 
same rate as the write rate, broadcast data can be reproduced in the 
normal speed. Symbols 't0» to 't2' shown in Fig. 38 correspond to 
broadcast data reproduction in the normal speed. 
In such a case that an audience again wishes to watch a broadcast 
program from the beginning portion thereof at the time instant 't2' shown 
in Fig. 38, a position of an address 'a0' is sought to set a read 
address. Thereafter, if the broadcast data is read at the normal speed 
rate, then the audience can again watch this broadcast program from the 
beginning portion thereof. 

In such a case that the audience wants to reproduce the broadcast data 
in the fast forward mode in the time shift watching style, the read rate 
is set to become higher than the normal rate. This corresponds to the 
time instants ' t2' to ' t3' shown in Fig. 38. During the time period, the 
inclination of the straight line becomes larger than that when the 
reproduction is performed in the normal speed. 

Symbols 't3' to ' t6' shown in Fig. 3 8 represent that the broadcast data 
is reproduced under time shift condition and also in the normal speed. 
This is called as an offset watching style. In this offset watching 
style, a straight line of a writing rate and also a straight line of a 
reading rate in Fig. 38 become in parallel to each other. In this case, a 
delay from the actual broadcasting time instant is equal to (t3 - tl) , 
since a scene which has been broadcasted at the time instant 1 tl ' is 
watched at a time instant 't3'. 

In the case of such a receiver which supports a reverse reproducing 
operation, when the broadcast data is reverse-reproduced, it becomes time 
instants ' t6 1 to ' t7' shown in Fig. 38. Since the broadcast data is read 
from the read address in the reverse direction, the read address is 
decreased while time has passed. The inclination of the straight line 
becomes a negative value. 

When the audience pauses at a certain position while the broadcast data 
is reproduced, as shown in symbols ' t7' to 't8' of Fig. 38, there is no 
change in the position of the read address a3, but only time is changed 
from the time instant ' t7' to the time instant 't8.' Thereafter, in order 
to catch up the real-time broadcast program, the write address is made 
equal to the read address. In Fig. 38, at the time instant 't8', the 
real-time broadcast program can be caught up. Subsequently, the audience 
can watch the program identical to the real-time broadcast. 
Since future reception data which has not yet been stored cannot be 
read out from the buffer disk, a solid line which indicates a change in 
reading time cannot be located above a dotted line which represents a 
change in writing time. 

As actions of audiences, a successive channel changing or so-called 
'zapping action (zapping operation)' is usually carried out by these 
audiences. In this zapping action, when a commercial message (CM) program 
is commenced and this CM program has no direct relationship with a 
broadcast program which is being watched by an audience, this audience 
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successively changes broadcast channels in order to seek other favorable 
programs. Various technical ideas capable of supporting this zapping 
action have been proposed. 

Japanese Patent Application Laid-open No, Hei 5-316440 discloses the 
following technique of the TV receiver. That is, while the CM program 
contained in the broadcast program is detected from the speech control 
signal of the receiving broadcasting system, this TV receiver 
automatically switches this receiving broadcasting channel to other 
broadcasting channel, or a previously-registered specific channel. 
Furthermore, this patent application discloses such a technical idea that 
even after the present broadcasting channel has been changed into another 
broadcasting channel, the original broadcasting channel is kept under 
reception condition. At the time instant when the CM program of the 
original broadcasting program is ended, the television receiver is 
automatically returned to the original broadcasting channel. 
As to such a technical point that another information is viewed during 
CM broadcasting, Japanese Patent Application Laid-open No. Hei 11-146296 
discloses the technical idea capable of automatically displaying the 
image information such as the Internet home page while the CM program is 
detected. Also, this patent application describes that as the information 
provided instead of the CM program, the retrieved results obtained from 
the various sorts of information database which are stored in the CD-ROM 
and the like are exemplified in addition to the Internet home page. 
In order to recognize a certain scene contained in a picture (video 
image) as a highlight scene, such a tag which may indicate 'highlight 
scene' must be added. A tag may be realized by previously adding tag data 
when broadcast data is transmitted on the side of a transmission station. 
Alternatively, a tag may be added on the side of a receiver. There are 
two tag adding methods executed on the side of the receiver, namely a 
manual tag adding method and an automatic tag adding method. Since such a 
tag indicative of 'highlight scene' is added to broadcast data, there are 
such merits that saved pictures may be simply retrieved, and contents of 
saved pictures may be grasped in short time. 

various retrieving methods have been proposed as to an automatic 
highlight scene retrieving method. For example, Japanese Patent 
Application Laid-open No. Hei 9-65287 discloses the technique of the 
featured scene listing method. That is, while the specific picture effect 
called 'desolve' contained in the broadcast program is sensed, the scene 
representative of the moving picture is specified. 

However, the above -explained known techniques have the below-mentioned 
problems. That is, the audience is normally relaxed while watching the 
broadcast program at home. Under such a circumstance, the audience never 
performs the time shift watching style unless there is such a specific 
reason that the program watching action by the audience is disturbed by 
the telephone call and/or the visitor. Also, in the prior technique, the 
audience must issue such an instruction by himself, namely, a chance to 
replay a program watched in a real time mode in a half way. 
The reasons why the zapping operation is carried out by audiences are 
mainly given as follows: 

(1) . In such a case that an audience does not have a clear decision on 
the next program after a presently watched broadcast program is ended, 
this audience has a necessary and positive reason directed to a program 
search, namely the audience roughly checks all of presently watchable 
programs and then searches a favorable program. 

(2) . An audience has such a passive reason: When the audience thinks 
it a waste of time merely to watch a CM program this audience tries to 
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search another channel program. Namely the presently watched CM program 
is replaced by the favorable broadcast program. 

(3) . An audience has a positive reason without any necessity: Since 

this audience cannot be satisfied with the presently watched program, the 
audience tries to search the more enjoyable program. 

(4) . A reason is established by combining the above- explained reasons 
(1) to (3) . 

Generally speaking, such a zapping operation becomes effective in such 
a case that an audience can find out more favorable program in another 
channel, as compared with the presently watched program. However, there 
are many possibilities that while a CM program is broadcast in a certain 
channel, CM programs are similarly broadcast in other channels. Finally, 
since the audience could not find out his favorable program in another 
channel, this audience is returned to the originally watched program. 
Moreover, when the audience is returned to the original channel, there 
are many chances that the CM broadcast has already been accomplished, and 
therefore, this audience loses a head portion of a broadcast program 
after this CM broadcast is accomplished. 

Also, since the zapping operation is required to perform the remote 
control many times, this remote control operation may cause very 
cumbersome operations for the audience. In the case that all of channels 
are not always free channels, but some channels are paid-channels, if an 
audience performs the zapping operation under careless condition, then 
the audience mistakenly watches such a paid-channel program, which may 
cause unnecessary expense. 

when the known technique disclosed in Japanese Patent Application 
Laid-open No. Hei 5-316440 is used (namely, CM program is automatically 
detected to change present channel into another channel) , the manual 
cumbersome operation required in the zapping operation can be eliminated. 
However, this known technique could not solve other difficulties. That 
is, the CM programs are similarly broadcast in other channels, and/or no 
other favorable programs are broadcast in other channels. 
On the other hand, when the known technique disclosed in Japanese 
Patent Application Laid-open No. Hei 11-146296 is used (namely, other 
image information is displayed while CM program is broadcasted) , the 
purpose for the CM program substitution (namely, audience watches 
information other than CM program) can be achieved. However, this 
technique cannot meet such a requirement that the audience wishes to 
watch once again the highlight scene of the originally watched program by 
utilizing watching time for the CM program. 

In general, a large number of CM programs are inserted into a time 
duration defined after a broadcast program is ended and before the next 
broadcast program is commenced. Also, spot news programs and weather 
forecast programs are inserted into this time duration. However, it is a 
waste of time when an audience again watches news programs and weather 
forecast programs, which have been already watched/known by this 
audience. As a consequence, the audience tries to change the presently 
watched channel into another channel. However, there are many 
opportunities that news programs and/or weather forecast programs are 
similarly broadcast in other channels at this channel change time. 
Therefore, the audience could not effectively utilize the time duration 
defined after one program is ended and until the next program is started, 
so that this audience may feel stress. 

Embodiments of the present invention may provide a broadcast receiver, 
a broadcast control method, and also a recording medium for recording 
thereon a computer program, by which an audience can avoid losing 
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interest as to a content of a broadcast program even in a CM broadcasting 
time range contained in this broadcast program, while this audience no 
longer performs the zapping operation. 

EP-A-0929127 describes a broadcast -program viewing method, which is 
capable of optionally viewing broadcast programs transmitted by a 
broadcasting station according to viewer's taste or desire. In a step 
(a) , original broadcast programs transmitted by a broadcasting station 
are received and stored onto an information storage medium capable of 
random access. Each of the received original broadcast programs contains 
items having attribute information. In a step (b) , the attribute 
information for the items of the received original broadcast programs is 
acquired and stored onto the information storage medium. In a step (c) , 
viewer's information is specified according to viewer's taste or desire. 
In a step (d) , the attribute information for the items of the received 
original broadcast programs and the specified viewer's information are 
compared to designate at least one desire item in the items of the 
received original broadcast programs having a desired relationship with 
the inputted viewer's information. In a step (el, the at least one 
desired item in the items of the received original broadcast programs are 
reproduced according to the specified viewer's information as a viewer's 
program. - 

US-A-5852 474 discloses a television receiver and a display method 
thereof, in which the television receiver includes a video signal 
processing circuit for receiving a video signal, converting the signal 
into a video display signal, and outputting the signal therefrom; a video 
signal storage circuit for receiving the video display signal from the 
processing circuit, recording the signal for a predetermined period of 
time, writing the video display signal in an overwriting manner after 
lapse of the predetermined period of time, and repeating the recording 
operation at an interval of the predetermined period of time; a switch 
circuit for receiving the video display signals from the video signal 
processing and storage circuits, combining the signals with each other in 
a switching fashion, and outputting a resultant signal therefrom; a 
control circuit for controlling the video signal storage circuit and 
switch circuit in response to an indication signal supplied from an 
external device, combining with each other the video display signals from 
either one or both of the video signal storage circuit and switch 
circuit, and outputting an obtained signal therefrom, and a display 
circuit for displaying thereon the video display signal outputted from 
the switch circuit. 

The invention is defined in the attached independent claims to which 
reference should now be made. Further, preferred features may be found in 
the sub-claims appended thereto. 

The present invention aims to solve the above described problems by 
employing the below-mentioned arrangements: 

That is, a broadcast receiver, according to the present invention, is 
featured by comprising: a highlight scene detecting unit for detecting a 
highlight scene of a broadcast program; means for storing at least the 
detected highlight scene of the program into a storage device; a CM 
detecting unit for detecting a CM {commercial message) broadcast program; 
and a reproducing control unit for reproducing the highlight scene stored 
in the storage device while the CM program is broadcast. 
In the broadcast receiver of the present invention, the CM detecting 
unit includes a CM start detecting unit for 

detecting a commencement of the CM broadcast; and when the CM broadcast 
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is commenced, the reproduction of the highlight scene may be commenced. 
In the present invention, a broadcast contains, for instance, a 
television broadcast or a radio broadcast. A broadcast receiver, 
according to the present invention, may be applied to a television 
broadcast receiver, a radio broadcast receiver (e.g., radio broadcasting 
system and/or radio-character broadcasting system), and the like. 
Also, in the present invention, an 'audience' may include a person who 
watches a television broadcast program or a person (listener, or 
receiver) who listens to a radio broadcast program. A detection of a 
highlight scene may be realized as follows: A portion capable of 
satisfying a predetermined detection condition may be detected as a 
highlight scene by executing an image recognition process operation 
and/or a speech recognition process operation. Also, such a portion may 
be detected based upon an index contained in broadcast data, or in 
response to an instruction of an audience. 

In accordance with the present invention, while an audience watches a 
broadcast program, when a CM program is commenced, the audience can watch 
a highlight scene of this broadcast program. In this way, the highlight 
scene of the broadcast program can be provided while the CM program is 
broadcast. Thus, the audience need not perform the zapping operation 
which is carried out in the known broadcast receiver. Also, the present 
invention can avoid such a problem that the audience loses interest and 
also concentration with respect to the broadcast program which is being 
watched, which is derived from the fact that the audience mistakenly 
receives other information by watching the CM program and also by 
performing the zapping operation. 

Also, the broadcast receiver, according to the present invention, may 
be arranged by such that the storage device stores thereinto a data 
portion of the broadcast data corresponding to a predetermined time 
duration at any time; and in such a case that when the CM broadcast is 
ended, the reproduction of the highlight scene has not yet accomplished, 
the reproducing control unit reproduces such broadcast data as appeared 
just after the CM broadcast is ended after the reproduction of the 
highlight scene is reproduced. A term 'broadcast data' involves picture 
(image) data and/or speech (voice) data related to a broadcast program, 
and furthermore, picture (image) data and/or speech (voice) data related 
to a CM program. 

Also, the broadcast receiver, according to the present invention, may 
be arranged by that in such a case that when the broadcast data is 
reproduced, a next CM broadcast is commenced, if a time difference 
between a broadcast time instant and a reproduction time instant exceeds 
broadcast time of the next CM broadcast program, the reproducing control 
unit continues to reproduce the broadcast data without executing the 
reproduction of the highlight scene. A term 'broadcast time instant' 
indicates a time instant elapsed in accordance with a broadcast program 
such as a television and a radio, whereas a term 'reproducing time 
instant' indicates a time instant (actual time instant) when broadcast 
data stored in a storage device is reproduced. 

Also, the broadcast receiver, according to the present invention, may 
have. a structure such that the storage device stores thereinto a data 
portion of the broadcast data corresponding to a predetermined time 
duration at any time; and when the CM broadcast is commenced, the 
reproducing control unit reproduces as the highlight scene, a broadcast 
data portion which is stored in the storage device, and is defined from a 
time instant when the CM broadcast is started and until a preselected 
time duration is retraced. 
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Also, the broadcast receiver, according to the present invention, may 
have a structure such that the broadcast program contains first speech 
(voice) and second speech (voice) ; and the broadcast receiver may further 
comprise: speech control means for providing any one of the first speech 
and the second speech when the broadcast program is provided in 
connection with a broadcast time instant; and also for providing the 
other speech between the first speech and the second speech when the 
highlight scene is reproduced. 

Also, the broadcast receiver, according to the present invention, may 
be configured such that the broadcast receiver is further comprised of: a 
highlight scene classifying unit for classifying the highlight scenes 
stored in the storage device into plural sorts of classifications; and 
the reproducing control unit reads out such a highlight scene having a 
sort corresponding to a taste of an audience with having a top priority 
from the storage device to reproduce the read highlight in such a case 
that the CM broadcast is commenced. 

Also, the broadcast receiver, according to the present invention, may 
have a structure such that the reproducing control unit reproduces any 
one of the highlight scene and a digest constituted of plural highlight 
scenes of a certain broadcast program during a time period defined after 
the certain broadcast program is ended and until a next broadcast program 
is commenced. 

Further, a broadcast control method, according to the present 
invention, is featured by that a highlight scene of a broadcast program 
is detected; at least the detected highlight scene of the program is 
stored into a storage device; a CM (commercial message) broadcast program 
is detected; and the highlight scene stored in the storage device while 
the CM program is broadcast is reproduced. 

Moreover, a computer readable recording medium for recording thereon a 
computer program, according to the present invention, is featured by such 
a recording medium for recording thereon a program used to cause a 
computer to execute: a step for detecting a highlight scene of a 
broadcast program; a step for storing at least the detected highlight 
scene of the program into a storage device; a step for detecting a CM 
(commercial message) broadcast program; and a 
step for reproducing the 

highlight scene stored in the storage device while the CM program is 
broadcast . 

Embodiments of the present invention will now be described, by way of 
example only, with reference to the accompanying drawings, in which: 
Fig. 1 schematically shows a hardware structure of a computer which 
may function as a broadcast receiver according to the present invention; 
Fig. 2 is a functional block diagram of a broadcast receiver according 
to a first embodiment of the present invention; 

Fig. 3 is a diagram for explaining a highlight index storage unit of 

the broadcast receiver according to the first embodiment; 

Fig. 4 is a diagram for explaining a CM index storage unit of the 

broadcast receiver according to the first embodiment; 

Fig. 5 is a flow chart for describing operations of the broadcast 

receiver according to the first embodiment; 

Fig. 6 is a flow chart for describing a highlight analyzing process 
operation of the broadcast receiver according to the first embodiment; 
Figs. 7A and 7B are flow charts for describing both a CM starting 
index storage process operation and a CM end index storage process 
operation, which are executed in the broadcast receiver according to the 
first embodiment; 
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Fig. 8 is a flow chart for describing a highlight selecting process 
operation of the broadcast receiver according to the first embodiment; 
Fig. 9 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk of the broadcast 
receiver according to the first embodiment; 

Fig. 10 is a functional block diagram of a broadcast receiver 
according to a second embodiment of the present invention; 
Fig. n is a flow chart for describing a highlight analyzing process 
operation executed in the broadcast receiver according to the second 
embodiment ; 

Fig. 12 is a functional block diagram of a broadcast receiver 
according to a third embodiment of the present invention; 
Fig. 13 is a diagram for explaining an input device (remote 
controller) of the broadcast receiver according to the third embodiment; 
Fig. 14 is a flow chart for describing a highlight analyzing process 
operation executed in the broadcast receiver according to the third 
embodiment ; 

Fig. 15 is a flow chart for describing operations of a broadcast 
receiver according to a fourth embodiment of the present invention; 
Fig. 16 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk employed in the 
broadcast receiver according to the fourth embodiment of the present 
invention; 

Fig. 17 is a diagram for indicating a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a fifth embodiment of the present 
invention; 

Fig. 18 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a sixth embodiment of the present 
invention; 

Fig. 19 is a diagram for indicating a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a seventh embodiment of the present 
invention; 

Fig. 20 is a diagram for explaining a highlight index storage unit 
employed in a broadcast receiver according to an eighth embodiment of the 
present invention; 

Fig. 21 is a diagram for representing a relationship between a write 
address and a read address with respect to a buffer disk employed in the 
broadcast receiver according to the eighth embodiment of the present 
invention; 

Fig. 22 is a diagram for indicating a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a ninth embodiment of the present 
invention; 

Fig. 23 is a functional block diagram of a broadcast receiver 
according to a tenth embodiment of the present invention; 
Fig. 24 is a flow chart for describing operations of the broadcast 
receiver according to the tenth embodiment; 

Fig. 25 is a functional block diagram of a broadcast receiver 

according to an llth embodiment of the present invention; 

Fig. 26 is a functional block diagram of a broadcast receiver 

according to a 12th embodiment of the present invention; 

Fig. 27 is a diagram for explaining a highlight index storage unit 

employed in the broadcast receiver according to the 12th embodiment; 
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Fig. 28 is a diagram for explaining a user taste database employed in 

the broadcast receiver according to the 12th embodiment; 

Fig. 29 is a functional block diagram of a broadcast receiver 

according to a 13th embodiment of the present invention; 

Fig. 30 is a flow chart for describing operations of the broadcast 

receiver according to the 13th embodiment; 

Fig. 31 is a diagram for indicating an example of a screen display 
image of the broadcast receiver according to the 13th embodiment; 
Fig. 32 is a flow chart for describing operations of a broadcast 
receiver according to a 14th embodiment of the present invention; 
Fig. 33 is a diagram for indicating an example of a screen display 
image of the broadcast receiver according to the 14th embodiment; 
Fig. 34 is a functional block diagram of a broadcast receiver 
according to a 15th embodiment of the present invention; 
Fig. 35 is a flow chart for describing operations of the broadcast 
receiver according to the 15th embodiment; 

Fig. 36 is a diagram for indicating an example of a screen display 
image of the broadcast receiver according to the 15th embodiment; 
Fig. 37 is a diagram for showing a relationship between a write 
address and a read address with respect to a buffer disk employed in a 
broadcast receiver according to a 16th embodiment of the present 
invention; and 

Fig. 38 is a diagram for representing the relationship among the write 
address, the read address, and the reproduction time with respect to the 
buffer disk during time shift watching operation. 

{FIRST EMBODIMENT) 

HARDWARE CONSTRUCTION OF BROADCAST RECEIVER 

Fig. 1 is a hardware structural diagram of a computer 1 which may 
function as a broadcast receiver {will be simply referred to as a 
'receiver* hereinafter) according to the present invention, and may 
realize a broadcast control method according to the present invention. 
The computer 1 corresponds to, for instance, a personal computer, a 
workstation, and the like (so-called 'TV-personal computer'), which is 
equipped with a digital television broadcasting reception function, and 
may function as a television broadcast receiver. 

In Fig. 1, the computer 1 is provided with a CPU (Central Processing 
Unit) 2, a ROM {Read-Only Memory) 3, a RAM (Random Access Memory) 4, a 
hard disk (HD) 5, floppy disk drive (FDD) 6, a CD-ROM drive 7, a display 
control apparatus 8, a communication control apparatus 9, and a plurality 
of interface circuits (I/F) 10 to 12. 

The ROM 3 previously stores thereinto an initiation program. The 
initiation program is executed by the CPU 2 when the power supply of the 
computer 1 is turned ON. As a result, both an operating system (OS) and 
either a single sort, or plural sorts of drive software (drivers) are 
loaded on the RAM 4, so that various sorts of process operations and 
control operations are brought into executable conditions. The single 
sort or plural sorts of drivers and also the operating system, which have 
been previously stored in the hard disk HD 5, are used to execute a 
display process operation and a communication process operation. 
Various sorts of computer programs for controlling the computer 1 are 
expanded to the RAM 4, and this RAM 4 is used as a work area of the CPU 
2. As a result, the RAM 4 may save a process result by a computer 
program, such temporarily-processed data used to execute a process 
operation, and such display data used to display the process result and 
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the like on the display screen on the display apparatus 15. 
The display data expanded on the RAM 4 is transferred via the display 
control apparatus 8 to the display apparatus 15. Upon receipt of the 
display data, the display apparatus 15 displays a display content 
corresponding to the display data on the display screen thereof. 
The HD 5 is a recording medium operable in such a manner that in 
response to an instruction issued from the CPU 2, this recording medium 
records thereon a program, control data, text data, image data, and the 
like. It should be noted that data/program read/write-operations with 
respect to this hard disk HD 5 are executed by a hard disk drive (not 
shown in detail) . 

The floppy disk drive FDD 20 corresponds to such a device used to 
execute either a read operation or a write operation with respect to a 
floppy disk (FD) 13. In response to an instruction issued from the CPU 2, 
this FDD 20 may read/write a program, control data, text data, image 
data, and the like with respect to the FD 13. 

The CD-ROM drive 7 corresponds to such a device capable of reading a 
program and/or data previously recorded on a CD-ROM 14 in response to an 
instruction issued from the CPU 2. The CD-ROM 14 is such a read-only 
memory using a compact disk (CD) . 

The display apparatus 15 is connected to the display control apparatus 
8. The display apparatus 15 is equipped with a monitor and a speaker used 
to output speech. The monitor is constructed of a cathode-ray tube (CRT), 
a liquid crystal display (LCD), and the like. 

The display control apparatus 8 contains a decoder 8a (see Fig. 2) . The 
decoder 8a decodes, or demodulates both image data and speech (voice, 
sound) data contained in broadcast data inputted into the computer 1 so 
as to obtain such data having a format processable by the display 
apparatus 15. Both the image data and the speech data contained in the 
broadcast data entered into the computer 1 are demodulated by the display 
control apparatus 8, and then, the demodulated image/speech data are 
processed by way of either the image display control process or the 
speech output control process, if required. Thereafter, the processed 
image/speech data are supplied to the display apparatus 15. 
To the communication control apparatus 9, a communication line 
connected to a network (not shown) is connected. In response to an 
instruction issued from the CPU 2, the communication control apparatus 9 
transmits/receives (involving uploads/downloads) a program and/or data 
with respect to another computer. 

A keyboard (KBD) 16 is connected to the interface I/F 10. This keyboard 
(KBD) 16 is provided with a plurality of keys (character input keys and 
cursor key etc.), and is used by an operator in order to input an 
instruction and data to the computer 1. 

Either a mouse 17 or a pointing device such as a track ball, a flat 
space, and a joystick is connected to another interface I/F 11. The mouse 
17 is used to input a selection instruction by employing a cursor 
displayed on the monitor of the display apparatus 15. 

A tuner 18 used to receive a digital television broadcasting program is 
connected to another interface I/F 12. This tuner 18 is connected to an 
antenna 19 for receiving digital television broadcasting electromagnetic 
waves such as CS broadcasting programs. The tuner 18 converts a digital 
TV broadcasting electromagnetic wave into a digital signal containing 
image data and speech data, and then, this converted digital signal is 
entered into the I/F 12. The I/F 12 converts a digital TV signal entered 
from the tuner 12 into such data having a format processable by the 
computer 1, and then, outputs this converted data to the bus BUS. 
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The CPU 2 executes various sorts of programs stored in the ROM 3, the 
HD 5, the FD 13, and the CD-ROM 14 (namely, these devices correspond to 
•recording medium' of the present invention). As a result, the computer 1 
may function as a broadcast receiver according to the present invention. 
It should be understood that the above -described programs and also data 
to be saved in the recording medium such as the HD 5 may be recorded on 
this recording medium by an operator in a manual manner. Alternatively, 
the computer 1 may download these programs/data from another computer to 
be recorded on the recording medium. 

Furthermore, the arrangement of the computer 1 shown in Fig. 1 may be 
replaced by that in which the tuner 18 is built in the computer 1. Also, 
the decoder may be provided outside this computer 1. 
It should also be noted that the CPU 2 may realize a highlight scene 
detecting unit, a means for storing a highlight scene into a storage 
device, a CM detecting unit, a CM start detecting unit, and a 
reproduction control unit. The hard disk HD 5 (buffer disk 21) 
corresponds to the storage device according to the present invention. 

FUNCTIONAL BLOCK OF BROADCAST RECEIVER 

Fig. 2 is a functional block diagram for showing an arrangement of a 
broadcast receiver according to a first embodiment of the present 
invention. The computer 1 indicated in Fig. 1 may function as a receiver 
20 which is connected to the tuner 18 and the decoder 8a contained in the 
display control apparatus 8, as shown in Fig. 2, since the CPU 2 executes 
a computer program. 

The tuner 18 receives a broadcasting electromagnetic wave received by 
the antenna 19, and then enters both image (video) data and speech 
(audio) data contained in the broadcasting electromagnetic wave into this 
receiver 20. The decoder 8a decodes (demodulates) both the image data and 
the speech data contained in the broadcasting electromagnetic wave, and 
then, supplies the decoded image/speech data to the display apparatus 15. 

As a result, an image data (picture) produced from the image data is 
displayed on the monitor of the display apparatus 15, and also speech 
(voice) produced from the speech data is outputted from the speaker. 
Therefore, the television broadcast programs may be provided with 
audiences. 

The receiver 20 is equipped with a buffer disk 21, a highlight scene 
analyzing unit 22, a CM start sensing unit 23, a CM end sensing unit 24, 
a highlight index storage unit 25, a CM index storage unit 26, a 
reproducing management unit 27, and a switch 28. The highlight scene 
analyzing unit 22 (will be referred to as an 'analyzing unit 22' 
hereinafter) corresponds to a highlight scene detecting unit. The CM 
start sensing unit 23 corresponds to a CM detecting unit, and a CM start 
detecting unit. The CM end sensing unit 24 corresponds to a CM detecting 
unit. The highlight index storage unit 25 corresponds to a means for 
storing a highlight scene into the storage device. The reproducing 
management unit 27 corresponds to a reproduction control unit. The 
analyzing unit 22, the CM start sensing unit 23, the CM end sensing unit 
24, and also the reproducing management unit 27 are such functions which 
can be realized by that the CPU 2 executes a computer program. 
The buffer disk 21 corresponds to such a ring buffer for temporarily 
storing thereinto broadcast data portions outputted from the tuner 18 
only for a predetermined time duration. When the buffer disk 21 stores 
the broadcast data up to a final address, the next address is returned to 
a head address. While the tuner 18 and the receiver 20 are initiated, 
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this buffer disk 21 arbitrarily, or temporarily stores thereinto the 
broadcast data of the selected channel. 

In this example, the buffer disk 21 is constituted by employing a hard 
disk. Alternatively, if random accessible media are available, then any 
type of random accessible media, for example, a RAM disk may be used as 
this buffer disk 21. 

The analyzing unit 22 acquires the broadcast data which is stored from 
the tuner 18 to the buffer disk 21, and then, analyzes the acquired 
broadcast data so as to detect a highlight scene of a broadcasting 
program. This analyzing unit 22 stores index information corresponding to 
the detected highlight scene into the highlight index storage unit 25. 
The analyzing unit 22 detects the highlight scene in accordance with 
both a detection starting condition and a detection end condition of the 
highlight scene, which are previously set, while using both the image 
data and the speech data contained in the broadcast data. In other words, 
the analyzing unit 22 detects as the highlight scene such broadcast data 
defined from a data portion coincident with the detection starting 
condition up to a data portion coincident with the detection end 
condition, as a result of an image recognition process, and a speech 
recognition process, and also a combination of these process operations. 
The analyzing unit 22 sets as a detection starting condition, for 
instance, such a condition that a difference between a preceding frame 
and a succeeding frame within an image is calculated, and an absolute 
value of this difference is larger than a predetermined threshold value, 
and further, a level of speech corresponding to the image is higher than 
a preselected threshold value. Then, the analyzing unit 22 detects image 
data defined from the image portion capable of satisfying this detection 
starting condition up to the image portion capable of satisfying a 
detection end condition as the above-described highlight scene. 
Also, the analyzing unit 22 detects the highlight scene, while a change 
in major colors of a screen is sensed so as to sense a change in 
displayed images, or a change in luminance brightness is utilized. 
Alternatively, the analyzing unit 22 detects as the highlight scene such 
an image where a specific key word (for example, name of hero) is 
recognized, while the image recognition process is combined with the 
speech recognition process. 

Then, the analyzing unit 22 detects both the starting time instant and 
the end time instant of the highlight scene, the addresses (namely, both 
starting address and end address) of the highlight scene on the buffer 
disk 21, and also the length of the highlight scene. The analyzing unit 

22 stores all of the above -described data into the highlight index 
storage unit 25 as the index information. 

Fig. 3 is an explanatory diagram for explaining the content of the 
highlight index storage unit 25 shown in Fig. 2. As indicated in Fig. 3, 
the highlight index storage unit 25 corresponds to such a table which 
records thereon index information of highlight scenes every highlight 
scene. This index information implies a starting time instant, a starting 
address, an end time instant, an end address, and a length. This table is 
formed on the RAM 4 . 

Returning back to Fig. 2, the CM start sensing unit 23 senses a start 
of a CM (commercial) program contained in a broadcasting program in such 
a manner that the CM start sensing unit 23 judges as a CM starting time 
instant, such a time instant at which a sound mode contained in 
broadcasting data stored in the buffer disk 21 is changed from a monoral 
sound mode to a stereophonic sound mode. When the CM start sensing unit 

23 senses starting of the CM program, this CM start sensing unit 23 
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acquires this starting time instant, and the address (starting address) 
of the broadcasting data corresponding to this starting time instant in 
the buffer disk 21. Then, the CM start sensing unit 23 stores the 
acquired CM starting time instant and the starting address into the CM 
index storage unit 26. 

The CM end sensing unit 24 senses an end of a CM (commercial) program 
contained in a broadcasting program in such a manner that the CM end 
sensing unit 24 judges as a CM end time instant, such a time instant at 
which a sound mode contained in broadcasting data stored in the buffer 
disk 21 is changed from a stereophonic sound mode to a monoral sound 
mode. When the CM end sensing unit 24 senses the end of the CM program, 
this CM end sensing unit 24 acquires this end time instant, and the 
address (end address) of the broadcasting data corresponding to this end 
time instant in the buffer disk 21. Then, the CM end sensing unit 24 
stores the acquired CM end time instant and the end address into the CM 
index storage unit 26. 

As the CM start sensing method by the CM start sensing unit 23, or the 
CM end sensing method by the CM end sensing unit 24, either the CM 
starting point or the CM end point may be sensed from a blank image 
portion between two continuous senses by way of a method similar to the 
analyzing unit 22, or may be sensed by utilizing such a fact that a sound 
volume level of a CM program is higher than that of a broadcasting 
program. 

Fig. 4 is an explanatory diagram for explaining the content of the CM 
index storage unit 26 shown in Fig. 2. As indicated in Fig. 4, the CM 
index storage unit 26 corresponds to such a table which records thereon 
index information of a CM program every CM broadcasting band. This index 
information implies a starting time instant, a starting address, an end 
time instant, an end address, and a length. This table is formed on the 
RAM 4. 

Returning back to Fig. 2, the reproducing management unit 27 manages 
reproducing operations of broadcasting data stored in the buffer disk 21 
based upon CM index information and highlight index information. 
In other words, the reproducing management unit 27 manages both the 
highlight index information stored in the highlight index storage unit 25 
and the CM index information stored in the CM index information storage 
unit 26. At a time instant when a CM broadcast is commenced, the 
reproducing management unit 2 7 detects the index information of the 
proper highlight scene from the highlight index storage unit 25, and sets 
the read address of the buffer disk 21 to the starting address which is 
written into the detected index information. 

The switch 28 switches the broadcast data inputted from the tuner 18 
and the broadcast data which is time-shifted and is supplied from the 
buffer disk 21 under control of the reproducing management unit 27. 
While one end of the switch 28 is connected to the decoder 8a, any one 
of the broadcast data inputted from the tuner 18 and the broadcast data 
supplied from the buffer disk 21 is entered to this decoder 8a. The 
decoder 8a decodes the entered broadcast data, and the decoded data is 
outputted from the display apparatus 15. It should also be noted that the 
switch 28 need not be physically realized, but may be realized by way of 
a conceptional idea. When this switch 28 is realized in a software 
manner, this switch 28 may be realized by the internal condition 
judgement. In other words, this switch 28 may be realized even by a 
mechanical switch, or an electronic switch. 

The reproducing management unit 27 performs the management of the 
reproducing operation in accordance with the below-mentioned sequential 

® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



http://print.westlaw.com/^ 1/17/2006 



Page 70 of 102 



operation. In other words, the reproducing management unit 27 detects the 
proper index information from the highlight index storage unit 25 at such 
a time instant when the CM start sensing unit 23 senses the commencement 
of the CM broadcast. Subsequently, the reproducing management unit 27 
sets the starting address of this index to the data read position of the 
buffer disk 21, and also switches the switch 28 to the switch side of the 
buffer disk 21 . 

Thereafter, the reproducing management unit 27 reads the broadcast data 
from the buffer disk 21 to supply the read broadcast data to the decoder 
8a until the CM end sensing unit 26 senses the end of this CM broadcast. 
At such a time instant when the CM broadcast is ended, the reproducing 
management unit 27 switches the switch 28 to the switch side of the tuner 
8a. As a result, while the CM program is broadcasted, the highlight scene 
data portion contained in the broadcast data recorded on the buffer disk 

21 is supplied to the decoder 8a. 

Fig. 5 to Fig. 8 are flow charts for representing operations of the 
receiver 20 according to the first embodiment of the present invention. 
Fig. 5 is a flow chart for explaining operations of the receiver 20 when 
broadcast data is received. Fig. 6 is a flow chart for explaining the 
content of the highlight analyzing 
process operation indicated in Fig. 5. 

Fig. 7(A) is a flow chart for explaining the content of the CM start 
index storage process operation shown in Fig. 5. Fig. 7 (B) is a flow 
chart for describing the content of the CM end index storage process 
operation shown in Fig. 5. Fig. 8 is a flow chart for describing the 
content of the highlight selection process operation indicated in Fig. 5. 

The process flow operation indicated in Fig. 5 is commenced by 
initiating the tuner 18, the receiver 20, the decoder 8a, and also the 
display apparatus 15 by turning ON the power supplies thereof in order 
that an audience watches a broadcasting program outputted from the 
display apparatus 15. 

As indicated in Fig. 5, at a step S01 of this flow chart, the CM start 
sensing process operation is executed. In other words, the CM start 
sensing unit 23 monitors the broadcast data supplied from the tuner 18, 
and judges as to whether or not a CM broadcast is commenced (step S02) , 
At this time, when the CM broadcast is commenced, this CM start sensing 
process is advanced to a step S06, whereas when the CM broadcast is not 
yet commenced, this sensing process operation is advanced to another step 
S03. 

At this step S03, a subroutine of the highlight analyzing process 
operation is executed. In other words, as indicated in Fig. 6, the 
analyzing unit 22 analyzes the broadcast data supplied from the tuner 18 
(step S031) so as to judge as to whether or not the highlight scene is 
commenced (step S032) . At this time, the analyzing unit 22 stores a 
starting time instant of the highlight scene into the highlight index 
storage unit 25 (step S033) when this analyzing unit 22 judges that the 
highlight scene is commenced (step S032; YES). Also, the analyzing unit 

22 stores into the highlight index storage unit 25, a recording position 
(starting address) in the buffer disk 21 as to the broadcast data, which 
corresponds to this starting time instant, and thereafter, the highlight 
analyzing process is accomplished. Subsequently, the process operation is 
advanced to a step S04 of Fig. 5. 

On the other hand, at the step S032, when the analyzing unit 22 judges 
that the highlight scene is not commenced (step S032; NO), the analyzing 
unit 22 judges as to whether or not the highlight scene is ended (step 
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S035) . When the analyzing unit 22 judges that the highlight scene is not 
yet ended (step S035; NO), the highlight analyzing process operation is 
ended, and the process operation is returned to the step S04 of Fig. 5. 
To the contrary, when the analyzing unit 22 judges that the highlight 
scene is ended (step S035; YES), the analyzing unit 22 stores an end time 
instant of the highlight scene into the highlight index storage unit 25 
(step S036), and also stores both a recording position (end address) in 
the buffer disk 21 as to the broadcast data, which corresponds to this 
end time instant, and a length of the highlight scene into the highlight 
index storage unit 25 (step S037) . Thereafter, the highlight analyzing 
process operation is accomplished, and then the process operation is 
advanced to the step S04 of Fig. 5. 

At the step S04, the broadcast program watching process for the 
audience is performed. In other words, the broadcast program providing 
process operation with respect to the audience is carried out. Concretely 
speaking, the broadcast data supplied from the tuner 18 is supplied to 
the decoder 8a, both the image data and the speech data contained in the 
broadcast data are decoded, or demodulated by this decoder 8a, and then, 
the image (picture) and the speech (voice) corresponding to the decoded 
image data and the decoded speech data are output from the display 
apparatus 15. Thereafter, the process operation is advanced to a step 
SOS. 

At this step SOS, the CPU judges as to whether or not the audience 
completes watching of the broadcast program, namely, the operation 
capable of accomplishing the process operation by the receiver 20 is 
executed. As this accomplishing operation, for example, the power supply 
of the computer l (receiver 20) is stopped, and the application program 
capable of realizing the receiver 20 is completed. At this time, in the 
case that the process accomplishing operation is executed, the CM start 
sensing process operation shown in Fig. 5 is ended. To the contrary, when 
the process accomplishing operation is not executed, this process 
operation is returned to the previous step SOI. 

On the other hand, at the step S06, a subroutine of the CM start index 
storage process operation is executed by that the CM start sensing unit 
23 judges the commencement of the CM broadcast at the previous step S02. 
In other words, as indicated in Fig. 7 (A), the CM start sensing unit 23 
detects a starting time instant of this CM broadcast to store this 
detected starting time instant into the CM index storage unit 26 (step 
S061), and also stores a recording position (starting address) in the 
buffer disk 21 as to the broadcast data, which corresponds to this 
starting time instant into the CM index storage unit 26 (step S062) . 
Thereafter, the CM starting index storage process operation is completed, 
and then, the process operation is advanced to a further step S07 of Fig. 
5. 

At the step S07, a CM end sensing process operation is executed. That 
is, the CM end sensing unit 24 monitors the broadcast data so as to judge 
as to whether or not the CM broadcast is completed (step S08) . At this 
time, when the CM end sensing unit 24 judges that the CM broadcast is 
ended (step S08; YES), the process operation is advanced to a step S14. 
To the contrary, when the CM end sensing unit 24 judges that the CM 
broadcast is not ended (step S08; NO), the process operation is advanced 
to a step S09. 

At this step S09, the reproducing management unit 27 judges as to 
whether or not the audience watches the highlight scene. In other words, 
the reproducing management unit 27 judges as to whether or not the 
broadcast data recorded on the buffer disk 21 is supplied to the decoder 
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8a in the present stage, when the audience watches the highlight scene 
(step S09; YES) , the process operation is advanced to a step S12 , whereas 
when the audience does not watch the highlight scene (step S09; NO), the 
process operation is advanced to a step S10. 

At the step S10, a subroutine of the highlight selection process 
operation is carried out. In other words, as shown in Fig. 8, the 
reproducing management unit 27 selects proper index information from the 
index information stored in the highlight index information storage unit 
25 (step S101) . In this case, as an example, the index information is 
selected in the order of the latest starting time instant. It should also 
be noted that the index information of the highlight scene may be 
selected in accordance with an arbitrary condition. 

Thereafter, the reproducing management unit 27 seeks the read head of 
the buffer disk 21 at a starting address contained in the selected index 
information (step S102) . As a consequence, such a condition may be 
established that the reproducing operation is commenced from the starting 
address of the highlight scene. Thereafter, the highlight selection 
process operation is ended, and the process operation is advanced to a 
step Sll of Fig . 5 . 

At the step Sll, the reproducing management unit 27 switches the switch 
28 from the switch side of the tuner 18 to the switch side of the buffer 
disk 21. As a consequence, the broadcast data which are sequentially read 
out from the starting address of the highlight scene are supplied to the 
decoder 8a. Thereafter, the process operation is advanced to a step S12. 
At this step S12, both pictures (images) and speech (voice) are 
outputted from the display apparatus 15, which are produced based upon 
the broadcast data decoded by the decoder 8a, As a consequence, the 
audience can watch the highlight scene recorded on the buffer disk 21. 
Thereafter, the process operation is advanced to a step S13 . 
At the step S13, similar to the above-described step S05, it is judged 
as to whether or not the audience stops watching the broadcast program, 
when the audience stops watching the broadcast program, the process 
operation of Fig. 5 is ended. To the contrary, when the audience is still 
watching the broadcast program, the process operation is returned to the 
previous step S07. 

On the other hand, in such a case thatit is so judged at the step S08 
that the CM broadcast is ended and then the process operation is advanced 
to a step S14, a CM end index storage process operation is carried out. 
In other words, as shown in Fig. 7(B), the CM end sensing unit 24 stores 
an end time instant of the CM broadcast into the CM index storage unit 26 
(step S063), and also stores into this CM index storage unit 26, both a 
storage position (end address) in the buffer disk 21 as to the broadcast 
data corresponding to this end time instant, and further, a length of 
this CM broadcast (step S064) . As a result, the CM end index storage 
process operation is accomplished, and the process operation is advanced 
to a step S15 of Fig. 5. 

At the step S15, the reproducing management unit 27 switches the switch 
28 from the switch side of the buffer disk 21 to the switch side of the 
tuner 18. This may cause such a condition that the broadcast data entered 
from the tuner 18 is supplied to the decoder 8a, so that the program 
watching mode is set. That is, the audience watches the broadcast program 
in real time. Thereafter, the process operation is advanced to the 
above-described step S03 . 

In the flow chart of Fig. 5, after the highlight analyzing process 
operation defined at the step S03 has been carried out, the program 
watching operation defined at the step S04 is executed in this order. 
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Alternatively, the process sequence order of the steps S03 and S04 may be 
carried out in such an order opposite to the above-explained order. 
Also, the process operation defined at the step Sll (switching process 
operation of switch 28) may be carried out at any process steps defined 
after the commencement of the CM broadcast is sensed and up to such a 
time instant when the data corresponding to the highlight scene is 
actually commenced to be processed. Also, in the case that the switch 28 
has already been switched, no specific process operation needs to be 
performed. 

Fig. 9 is a diagram for indicating a relationship between a write 
address and a read address in the buffer disk 21 employed in the receiver 
20 according to the first embodiment. In Fig. 9, there are indicated that 
at a CM broadcast starting time instant, a starting address corresponding 
to a starting time instant of a highlight scene is sought, whereas at a 
CM broadcast ending time instant, the present address is returned to a 
position of a received broadcast program (starting address becomes 
address before being sought) . 

In Fig. 9, this relationship indicates such a case that a length of a 
highlight scene contained in a commercial broadcast 'CM1' is made longer 
than a CM broadcasting time range. In this case, when the CM broadcast is 
ended, the watching position is returned to the real-time watching 
position . 

Another commercial broadcast ' CM2 ' shows an example where two pieces of 
highlight scenes are inserted into a single broadcasting time range. The 
highlight scenes are reproduced in the order of the latest starting time 
instant. As previously explained, when the reproducing operation of a 
certain highlight scene contained in the CM broadcast is accomplished, 
another highlight scene is selected and reproduced until the end of the 
CM broadcast is sensed. 

In accordance with the receiver 20 of this first embodiment, only such 
a data portion (broadcast data) of a broadcast program defined by a 
constant (predetermined) time duration is stored into the buffer disk 21, 
and this broadcast program is provided via the receiver 20 to an 
audience. A highlight scene is detected from the broadcast data stored in 
this buffer disk 21, and both a starting address and an end address in 
the buffer disk 21 as to this detected highlight scene are saved. 
Thereafter, in such a case that the audience watches a broadcast 
program in real time (program watching mode) , when a CM broadcast is 
commenced, the broadcast data of the highlight scene stored in the buffer 
disk 21 is read based on both the saved starting address and the saved 
end address, and then, the read broadcast data is reproduced. As a 
result, both the picture and the speech produced based upon this 
highlight scene broadcast data are supplied to the audience (highlight 
watching mode) . Then, either a single piece or plural pieces of 
highlight scenes may be provided to the audience until the end of this CM 
broadcast is sensed. 

Thereafter, when the end of this CM broadcast is sensed, both a picture 
(image) and speech (voice) produced based on broadcast data acquired from 
the tuner 18 are provided to the audience. In other words, the present 
highlight watching mode is switched back to the program watching mode, so 
that the audience may watch the broadcast program in real time. 
As a consequence, while the CM program is being broadcasted (either CM 
broadcasting time range within program or CM broadcasting time range 
between programs) , the audience can watch the highlight scenes recorded 
on the buffer disk 21. 

In accordance with the first embodiment, at the time when the CM 
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broadcast is commenced, the audience can automatically watch such a 
program one more time, which has been watched so far, so that such 
useless operation as zapping operation executed while the CM program is 
broadcasted is no longer required. Also, since the highlight scene of the 
broadcast program is reproduced, it is possible to avoid such a fact that 
the audiences will lose their concentration and their interests to the 
broadcast program. Therefore, the audiences can further enjoy watching 
the program, as compared with that of the conventional broadcast 
receiver. Further, since the highlight scenes are automatically 
reproduced, this broadcast receiver can eliminate cumbersome operations 
of replay designations by the audiences. 

(SECOND EMBODIMENT) 

Fig. 10 is a functional block diagram of a receiver 20A according to a 
second embodiment of the present invention. It should be noted that the 
receiver 20A of this second embodiment may be realized by employing the 
hardware structure (see Fig. 38) as explained in the above -explained 
first embodiment, and the functional block of Fig. 10 is substantially 
the same as that of the first embodiment, except that a highlight tag 
analyzing unit 22A (will be referred to as an 'analyzing unit 22A' 
hereinafter) is provided instead of the highlight scene analyzing unit 22 
employed in the first embodiment . 

The analyzing unit 22A interprets tag information (equal to index) 
corresponding to a highlight scene previously inserted into the broadcast 
data. In other words, while a broadcast station previously inserts 
specific tag information into a user area of broadcast data and then 
transmits the tag-inserted broadcast data, since the highlight tag 
analyzing unit 22A interprets the inserted tag from the received 
broadcast data, both a starting position and an end position of the 
highlight scene can be grasped which is designated on the side of the 
broadcast station. 

A highlight index sorts highlight scenes interpreted by tags in the 
temporal order, and a data structure of a highlight index storage unit 25 
is similar to that of the first embodiment. 

Although operations of the receiver 20A according to the second 
embodiment are substantially equal to those of the first embodiment (see 
Fig. 5), this receiver 20A owns such a different operation in the content 
of the highlight analyzing process operation step (step S03) by the 
analyzing unit 22A. In other words, in the receiver 22A of the second 
embodiment, instead of the operations defined in the flow chart of Fig. 
6, this receiver 22A is operated in accordance with a highlight analyzing 
process operation shown in Fig. 11 according to the second embodiment. 
In Fig. 11, at a step S201, the analyzing unit 22A executes a highlight 
tag analyzing process operation and then, analyzes/ judges as to whether 
or not a tag indicative of a highlight scene is contained in broadcast 
data (step S202) . 

At this time, as a result of analysis, when the analyzing unit 22A 
detects such a tag indicative of a commencement of this highlight scene 
(step S202; YES), this analyzing unit 22A stores as a highlight index 
into the highlight storage unit 25, both a starting time instant of the 
highlight scene corresponding to this tag and also a position (starting 
address) corresponding to this starting time instant as to the buffer 
disk 21 (steps S203 and S204) . 

Also, in the case that the analyzing unit 22A detects such a tag 
indicative of an end of the highlight scene (step S205; YES) , this 
analyzing unit 22A writes into the relevant positions of the highlight 
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index storage unit 25, both an end time instant of the highlight scene 
corresponding to this tag and also a position (end address) corresponding 
to this end time instant as to the buffer disk 21 (steps S206 and S207) . 
Similar to the first embodiment, subsequently, when a CM broadcast is 
commenced, the reproducing management unit 27 may provide the highlight 
scene recorded on the buffer disk 21 to the audience instead of the CM 
broadcast, in accordance with the highlight scene index. 
In this second embodiment, while the broadcasting station previously 
multiplexes the tag information on the data of the broadcast program to 
broadcast the multiplexed broadcast data with such tag information 
functioning as the index indicative of the highlight scene, the receiver 
20A interprets this tag information to detect the highlight scene 
indicated by the tag information, and then reproduces the highlight scene 
while the CM program is broadcasted. 

Similar to the above -explained first embodiment, as a consequence, the 
audience can automatically watch such a program, which has been so far 
watched, at the time when the CM broadcast is commenced. Furthermore, the 
receiver 20A need not detect the highlight scene by executing the image 
recognition process operation and the speech recognition process 
operation, but also the highlight scene intentionally designated by the 
broadcast station can be supplied to the audience, so that the audience 
can enjoy watching of the broadcast program. 

(THIRD EMBODIMENT) 

Fig. 12 is a functional block diagram of a receiver 20B according to a 
third embodiment of the present invention. It should be noted that the 
receiver 20B of this third embodiment may be realized by employing the 
hardware structure (see Fig. 38) as explained in the above -explained 
first embodiment, and the functional block of Fig. 12 is substantially 
same as that of the first embodiment, except that a replay subject 
automatic judging unit 22B (will be referred to as a 'judging unit 22B* 
hereinafter) is provided instead of the highlight scene analyzing unit 
22, a replay subject index storage unit 25B is employed instead of the 
highlight index storage unit 25, and furthermore, an input device 31 is 
newly employed. 

The input device 31 may be arranged by employing the keyboard 16 and 
the mouse 17 indicated in Fig. 38. Also, the input device 31 may be 
arranged by using a remote controller 32, Alternatively, the input device 
31 may be arranged by a microphone and a speech recognizing apparatus. 
This microphone is used to instruct the receiver 20B by a speech manner. 
In the third embodiment, the remote controller 32 is employed as this 
input device 31. Fig. 13 is a diagram for indicating an example of this 
remote controller 32. The remote controller 32 is arranged in such a way 
that a designation button 33 is provided with the conventional television 
remote controller. This designation button 33 (subject to be replayed 
later) is exclusively used to designate a replay subject. When an 
audience again wishes to watch a scene (namely, audience judges this 
scene as a highlight scene) while a broadcast program is watched, if the 
audience depresses this designation button 33, then this audience may 
watch such a scene corresponding to the designated replay subject 
(highlight scene) during the subsequent CM broadcasting time. 
In such a case that the audience designates the relay subject by using 
the input device 31 (by pressing designation button 33), the judging unit 
22B automatically judges the replay subject in accordance with this 
designation. 

For instance, the judging unit 22B sets positions as a replay subject, 
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which are defined from one position corresponding to a time instant 
preceding to such a time instant when a designation is received by a 
predetermined time duration up to another position corresponding to the 
time instant when the designation is received. Alternatively, the judging 
unit 22B may set as a replay subject, a predetermined time duration 
before/after a designated time instant as a center. Also, the length of 
the replay subject may be selected to be a fixed length, or may be 
changed by the audience manipulating the input device 31. 
Then, the judging unit 22B acquires a starting time instant of the 
replay subject, a starting address thereof, an end time instant of the 
replay subject, and an end address thereof. This judging unit 22B stores 
these acquired items into the replay position index storage unit 25B. 
The replay position index storage unit 25B stores the starting time 
instant of the replay subject, the starting address thereof, the end time 
instant of the replay subject, and the end address, which are acquired by 
the judging unit 22B, in a table form for every replay subject, A data 
structure of the replay position index storage unit 25B is identical to 
that of the highlight index storage unit 25 shown in Fig. 3. 
Operations of the receiver 20B according to the third embodiment are 
substantially equal to those of the first embodiment (see Fig. 5). There 
is only such a different operation, namely a content of a highlight 
analyzing process operation (step S03) executed by the judging unit 22B. 
In other words, in accordance with the receiver 20B of this third 
embodiment, operations are executed in accordance with such a highlight 
analyzing process operation shown in Fig. 14, instead of the process 
operation of the flow chart indicated in Fig. 6. 

While a broadcast program is received, in the case that a designation 
of a replay subject from an audience is entered into the receiver 20B by 
manipulating the input device 31 (step S301; YES), the judging unit 22B 
automatically judges the replay subject based upon a time instant when 
the designation is received (step S302) , 

Subsequently, the judging unit 22B stores both a starting time instant 
of the replay subject and also an end time instant thereof into the 
subject index storage unit 25B (step S303), and also stores into this 
replay subject index storage unit 25B, both a starting address of this 
replay subject and an end address thereof as to the buffer disk 21 (step 
S304) . 

The subsequent operation of this receiver 20B is substantially equal to 
that of the first embodiment. In such a case that the commencement of the 
CM broadcast is detected, the reproducing management unit 27 reads out a 
proper replay subject index from the replay subject index storage unit 
25B, and then, reads out broadcast data corresponding to this read replay 
subject index from the buffer disk 21 to supply the read broadcast data 
to the decoder 8a, As a result, in the CM broadcast time range, both the 
picture and the speech, which correspond to the replay subject (highlight 
scene) designated by the audience, may be supplied instead of the CM 
broadcast program. 

Similar to the first embodiment, in accordance with the third 
embodiment, since the highlight scene is reproduced during the CM 
broadcast time, both the problem occurred while the CM program is watched 
and the problem 

of the zapping operation can be solved at the same time. 
Furthermore, since the replay subject wanted by the audience is 
registered as the highlight scene, the audience can more deeply enjoy 
watching the broadcast program. 
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(FOURTH EMBODIMENT) 

Next, a description is made of a fourth embodiment according to the 
present invention. A receiver of this fourth embodiment owns such an 
arrangement capable of solving the below-mentioned problems. 
In the first to third embodiments, in the case that length of the 
highlight scene is longer than the length of the CM program, the 
reproducing operation of the highlight scene is automatically 
accomplished at the time instant when the end of this CM program is 
sensed, and then, the highlight scene watching mode is returned to the 
program watching mode. As a result, the first to third embodiments cannot 
satisfy such a requirement made by the audience that this audience wishes 
to continuously watch the highlight scene. 

Since both a hardware construction and a functional block of the 
receiver according to the fourth embodiment are similar to those of the 
above- explained first embodiment (see Fig. 1 and Fig. 2), explanations of 
these hardware construction/functional block are omitted. It should be 
understood that the operation of the receiver according to the fourth 
embodiment is different from that of the first embodiment. 
Fig, 15 is a flow chart for explaining operation of the receiver 20 
according to the fourth embodiment. This receiver operation of the fourth 
embodiment is different from the receiver operation (see Fig. 5) of the 
first embodiment as follows. 

(1) The execution order of both the condition judgment (step S08) for 
judging the end of the CM broadcast and the condition judgment (step S09) 
made while the highlight scene is watched is reversed, ad compared with 
that of the first embodiment (see steps S408 and S409) . 

(2) When the end of the CM broadcast is detected (step S409; YES) , the 
address of the CM end position is sought (step S415) and the present mode 
is advanced to an offset watching mode (step S404) . 

In other words, in the first embodiment, when the end of the CM 
broadcast is sensed, the highlight scene watching mode is immediately 
advanced to the program watching mode (step S04 of Fig. 5) . To the 
contrary, in the receiver of the fourth embodiment, the highlight scene 
watching mode is not advanced to the program watching mode until the 
reproducing operation of the highlight scene is accomplished which is 
being reproduced during the CM broadcasting operation. 
As a consequence, in such a case that a length of a highlight scene 
reproduced in the CM broadcast time range is longer than this CM 
broadcast time range, when the end position of the CM broadcast is 
returned after the highlight scene has been watched, the present watching 
mode is brought into an offset watching mode delayed by preselected time 
from the program watching mode (real time watching mode) . 
Fig. 16 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the fourth embodiment. In Fig. 16, when a CM program starts to be 
broadcasted, a starting address of a highlight scene is sought and thus, 
the sought highlight scene is reproduced. 

Thereafter, in such a case that the reproducing operation of the 
highlight scene is not yet accomplished even at the time instant when the 
CM broadcast is ended, the present watching mode is returned to the CM 
end position after this highlight scene is accomplished. Thereafter, the 
offset watching mode is continued until a commencement of a next CM 
broadcast is sensed. This operation is indicated between the CM broadcast 
1 CM1» and the CM broadcast 1 CM2 1 shown in Fig. 16. As apparent from this 
drawing, there is a time delay from the real time watching operation. 
Similar to the program watching mode, in such a case that a 
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commencement of a CM broadcast is sensed during the offset watching mode, 
a highlight scene is sought. When the highlight scene is ended, the 
present watching mode is returned to the CM end position. This fact is 
represented as a portion related to the commercial 1 CM2 1 in Fig. 16. 
In accordance with the receiver of the fourth embodiment, when the CM 
broadcast is ended, the present watching mode is not immediately returned 
to the original broadcasting operation, but the reproducing operation is 
commenced from the CM end position of the original broadcasting operation 
after the highlight scene has been accomplished, while using the 
principle idea of the offset watching mode of the time shift watching 
operation. As a consequence, even when the length of the highlight scene 
is long, the audience can continuously watch the program without 
receiving any stress. 

(FIFTH EMBODIMENT) 

Next, a description is made of a fifth embodiment according to the 
present invention. A receiver of this fifth embodiment owns such an 
arrangement capable of solving the below-mentioned problems. 
In a television broadcasting program such as movies, for an audience to 
have a clear recognition of a movie story, a CM program is not inserted 
into this movie television broadcasting program for a preselected time 
after this broadcasting program is commenced. However, since a time 
duration required to broadcast CM programs is determined based upon a 
contract, these CM programs are concentrately broadcasted in a rear half 
portion of a broadcast program. As a result, while interests of the 
audience become emphasized in this rear half program portion, the CM 
programs are frequently broadcasted, so that this audience may feel 
strong stress while this audience watches the movie on television. 
Since both a hardware construction and a functional block of the 
receiver according to the fifth embodiment are similar to those of the 
above-explained first embodiment (see Fig. 1 and Fig. 2), explanations of 
these hardware construction/functional block are omitted. Also, similar 
to the fourth embodiment, in the receiver of this fifth embodiment, when 
a CM broadcast is accomplished while a highlight scene is reproduced, 
after the reproducing operation of the highlight scene is ended, the 
offset watching mode is commenced (see Fig. 15) . 

It should be understood that the operation of the receiver according to 
the fifth embodiment is different from that of the fourth embodiment. 
That is, the reproducing time of the highlight scene which is provided to 
the audience while the CM program is broadcasted is always made longer 
than the CM broadcasting time. As a result, in the CM broadcasting time 
range which is inserted into the rear half portion of the broadcast 
program, a time difference between a real time watching operation and an 
offset watching operation (time difference between broadcasting time 
instant and reproducing time instant in television broadcasting 
operation) may become longer than the CM broadcasting time. As a 
consequence, the audience can watch this television broadcasting program 
under such a condition that the CM broadcast is completely cut from this 
television broadcasting program. 

Fig. 17 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the fifth embodiment. In Fig. 17, when a CM program starts to be 
broadcasted, a starting address of a highlight scene is sought and thus, 
the sought highlight scene is reproduced. At this time, the present 
watching operation is returned to the end position of the CM broadcast. 
In this embodiment, the reproducing time of the highlight scene is made 
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slightly longer, and this highlight scene is inserted to a front half 
portion of a broadcast program and is reproduced while a CM program is 
broadcasted. As a result, in the CM broadcasting time range which is 
inserted into a rear half portion of the broadcast program, the time 
difference between the real time watching operation and the offset 
watching operation is prolonged. As a result, in the CM broadcasting time 
range of the program rear half portion, even when the highlight scene is 
not reproduced, the CM broadcasting operation can be cut. This fact is 
indicated as a portion of a commercial program 1 CM3 1 and a portion of a 
commercial program 1 CM4 1 indicated in Fig. 17. 

In accordance with the fifth embodiment, the length of the highlight 
scene is continuously prolonged and inserted in the CM broadcast time in 
the front half portion of the program, whereas no highlight scene is 
inserted in the CM broadcast time in the rear half portion of this 
program. As a result, as the program proceeds to the real half portion, 
the time difference between the original program broadcast and the 
actually watched scenes will become longer. This time is allocated to the 
CM broadcast time in the rear half portion of the program, and may be 
used so as to cut the CM program. 

As a consequence, in such a case that the audience watches such a 
program having a story such as movies and TV dramas on the television, 
this audience can be released from the CM programs which are frequently 
inserted into the rear half portion of the program, and therefore, can 
watch a climax portion of this program without interruptions of the CM 
programs. As a result, the audience can watch this broadcast program with 
his satisfaction. 
(SIXTH EMBODIMENT) 

Next, a description is made of a sixth embodiment according to the 
present invention. Since both a hardware construction and a functional 
block of a receiver according to the sixth embodiment are similar to 
those of the above-explained first embodiment (see Fig. 1 and Fig. 2), 
explanations of these hardware construction/functional block are omitted. 

It should be understood that the operation of the receiver according to 
the sixth embodiment is different from that of the first embodiment as to 
such a point that a program digest is used as a highlight scene. This 
program digest implies that highlight scenes contained in a broadcast 
program, and acquired from a time instant when a preceding CM 
broadcasting time range is ended up to another time instant when a 
present CM broadcasting program is commenced (CM broadcasting time range) 
are coupled to each other without deteriorating a flow of a story. 
The program digest may be formed in such a manner that the reproducing 
management unit 27 reproduces a plurality of highlight scenes detected by 
the analyzing unit 22 in accordance with, for instance, the 
below-mentioned method. 

(1) In such a case that a plurality of highlight scenes are detected 
by the analyzing unit 22 from a program during a CM broadcasting time 
range, and the present CM broadcast is commenced, the reproducing 
management unit 27 reproduces a plurality of detected highlight scenes in 
a time sequential manner by equally increasing a reproducing speed. 

(2) While the analyzing unit 22 detects, for example, a scene where 
actors speak many lines as a plurality of highlight scenes from broadcast 
data in a program during a CM broadcasting time range, the reproducing 
management unit 27 continuously reproduces a plurality of detected 
highlight scenes when a CM broadcast is commenced. 

It should also be noted that if a content of a program during a CM 
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broadcast time range is used and also a story of this program content is 
not deteriorated, then this program digest may be edited in any way. 
Fig. 18 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the sixth embodiment, in Fig. 18 , a grey meshed portion indicates such a 
fact that a program digest is reproduced, and this program digest is 
related to such a program which has been broadcasted in the CM 
broadcasting time range immediately before in each of the CM broadcasting 
time ranges. 

For example, in a CM broadcasting time range of ■CM2' / a program digest 
is provided to an audience. This program digest is related to a content 
of a program defined from a time instant when 'CM1' is completed until 
1 CM2 1 is commenced, which correspond to a CM broadcasting time range 
before this ■ CM2 ' . Thereafter, when the end of this CM broadcast is 
sensed, the reproduction of the program digest is ended, and then, the 
present watching mode is advanced to the program watching mode. 
In accordance with the sixth embodiment, as the highlight scene, such a 
program digest is reproduced, which is acquired for a time duration 
defined from a position where the preceding CM is inserted until the 
present CM is commenced. As a consequence, when the audience watches such 
a program having a story such as movies and dramas, this audience can 
confirm a rough outline of this story during the CM broadcasting time, 
and can again confirm the content of the program in such a case that the 
audience has not grasped the content of this story. Since the program 
digest is automatically displayed during the CM broadcasting time, this 
program digest display may give very large merits to the user. 

(SEVENTH EMBODIMENT) 

Next, a description is made of a seventh embodiment according to the 
present invention. Since both a hardware construction and a functional 
block of a receiver according to the seventh embodiment are similar to 
those of the above-explained first embodiment (see Fig. 1 and Fig. 2), 
explanations of these hardware construction/functional block are omitted. 
It should be understood that the operation of the receiver according to 
the seventh embodiment is different from that of the first embodiment as 
to such a point that a CM broadcast program portion of a CM broadcast 
program, which is temporally returned (retraced) back from a starting 
time instant of this CM broadcast program by a constant time period, is 
used as a highlight scene. 

For example, in the case that a CM broadcasting time range contained in 
a broadcast program is 2 minutes, the analyzing unit 22 detects a program 
portion of a CM broadcast program as a highlight scene, and this program 
portion is temporally returned back from a starting time instant of this 
CM broadcast program by 2 minutes. Then, the analyzing unit 22 records a 
highlight index (staring address, end address, etc.) of this highlight 
scene on the highlight index storage unit 25. Thereafter, when the 
commencement of the CM broadcast is sensed, the reproducing management 
unit 27 reproduces this program portion in accordance with the highlight 
index . 

Thereafter, when the CM end sensing unit 24 senses an end of this CM 
broadcast, the reproducing management unit 27 switches the present 
watching mode to the program watching mode. As a consequence, the 
audience can watch the broadcast program under such a condition that the 
CM broadcast program has been cut out from this program. 
Fig. 19 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of . 
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the seventh embodiment. In Fig. 19, when a CM program starts to be 
broadcasted, such a fact is indicated that an address retraced for a 
length of a CM broadcasting time range is sought. 

Also, there is shown such a fact in Fig. 19, that at a time instant 
when an end of a CM broadcast is sensed, the present watching mode is 
advanced to the program watching mode, and then, an audience watches a 
program in real time. This may achieve the same effect in the case that 
the audience watches the program from which the CM broadcast is cut out. 
In accordance with the seventh embodiment, as the highlight scene, the 
CM program portion is reproduced, which is retraced from the broadcast 
program just before the CM program is commenced only by a 
previously-designated time duration. As a result, when the audience 
watches such a program having. a story such as movies and dramas, the 
audience can continuously watch this program without the story being 
interrupted by the CM program, which is very useful for the audience. 

(EIGHTH EMBODIMENT) 

Next, a description is made of an eighth embodiment according to the 
present invention. Since both a hardware construction and a functional 
block of a receiver according to the eighth embodiment are substantially 
similar to those of the above- explained first embodiment (see Fig. 1 and 
Fig. 2), explanations of these hardware construction/functional block are 
omitted. It should be understood that the operation of the receiver 
according to the eighth embodiment is different from that of the first 
embodiment. That is to say, while the analyzing unit 22 applies weight 
with respect to a plurality of detected highlight scenes, the reproducing 
management unit 27 changes a reproducing speed in response to a weight of 
a highlight scene. 

Fig. 20 is an explanatory diagram for explaining a data structure of a 
highlight index storage unit 25H employed in the receiver of the eighth 
embodiment. In Fig. 20, this highlight index storage unit 25H saves 
thereinto, every highlight scene, the weighing values (importance 
degrees: in this example, any value of 1 to 10) of the highlight scenes 
calculated by the analyzing unit 22 in addition to the starting address, 
the starting time instant, the end address, the end time instant, and the 
length of the highlight scene, which are explained in connection with the 
first embodiment. 

The analyzing unit 22 performs the weighing operation in accordance 
with the below-mentioned manner, for example. That is, in such a scene 
that a screen owns small movement, the analyzing unit 22 sets the weight 
of the highlight scene to a small weight value. The reason resides in 
that even when the screen is fed in a fast speed, since a change in the 
screens is small, the audience can easily trace the story. To the 
contrary, in such a scene that a screen owns strong movement, the 
analyzing unit 22 sets the weight of the highlight scene to a large 
weight value. The reason resides in that when the screen is fed in the 
fast speed in such a scene where the movement thereof is strong, it is 
conceivable that the audience cannot grasp the story. Also, in such a 
case that the weighting operation is carried out by way of the speech 
(voice) manner, for example, the analyzing unit 22 sets the small 
weighting value in such a scene where the actor's lines are few, whereas 
the analyzing unit 22 sets the large weighting value in such a scene 
where the actor's lines are numerous. Alternatively, the analyzing unit 
22 may set the weighing value by combing these parameters. 
Fig. 21 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
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the eighth embodiment. In Fig. 21, as the highlight scene to be 
reproduced in the CM broadcasting time range, the weighted scene is used. 
The highlight scene whose importance degree is low is reproduced in the 
fast feeding mode, whereas the highlight scene whose importance degree is 
high is reproduced in the slow feeding mode. 

It should also be noted that the above-described arrangement of the 
receiver of this eighth embodiment may be substituted by the 
below-mentioned arrangement. That is, as explained in the second 
embodiment, while both a tag and such data indicative of an importance 
degree may be added to broadcast data on the side of a broadcast station, 
the data indicative of the importance degree may be detected by the 
analyzing unit 22 on the side of the receiver. Alternatively, as 
explained in the third embodiment, while an audience may designate an 
importance degree by employing the input device 31, the analyzing unit 22 
may detect the designated importance degree. 

In the eighth embodiment, an image is provided to the audience, in 
which the reproducing speed is changed in response to the importance 
degree of the highlight scene. As a consequence, the audience can confirm 
the detailed portion of the important scene by way of the slow 
reproducing operation. Conversely, the audience can watch such a scene 
having a low importance degree by way of the fast -feed reproducing 
operation. Accordingly, the audience can watch the important portion in 
detail, while grasping the entire story to some extent. 

(NINTH EMBODIMENT) 

Next, a description is made of a ninth embodiment according to the 
present invention. A receiver of this ninth embodiment owns such an 
arrangement capable of solving the below-mentioned problems. 
In the case that a prize contest source of gifts is displayed to 
audiences in a broadcast program, this prize contest source is normally 
displayed only for several seconds. As a consequence, it is practically 
difficult for audiences to completely write this prize contest source on 
a memorandum and the like. As a consequence, the audiences memorize this 
prize contest source and thereafter write the memorized prize contest 
source on paper, or several audiences try to partially memorize this 
prize contest source, and thereafter, finally construct the complete 
prize contest source. To avoid such a difficulty, one broadcast receiver 
is commercially available and is equipped with such a function that one 
frame contained in a broadcast program is captured as a still image on a 
separate window. 

However, in this type of broadcast receiver, when such a still image as 
a destination address displayed on the separate window becomes 
unnecessary, this still image must be discarded. This still picture 
discarding operation must be carried out in a manual manner. Also, since 
the still image is displayed on the separate window, this still image 
must be located on the uppermost position on the display screen, or the 
display screen must be changed. Furthermore, in such a case that the 
still image is displayed in a reducing size mode, resolution of the 
characters is decreased. There is such a drawback that these characters 
can be hardly read by the audiences. 

Since both a hardware construction and a functional block of a receiver 
according to the ninth embodiment are substantially similar to those of 
the above-explained first embodiment (see Fig. 1 and Fig. 2), It should 
be understood that the operation of the receiver according to the ninth 
embodiment is different from that of the first embodiment as to such a 
technical point that the reproducing management unit 27 provides a still 
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image of one scene contained in a broadcast program as a highlight scene 
to an audience . 

Fig. 22 is a diagram for indicating a relationship between a write 
address and a read address to the buffer disk 21 in the receiver 20 of 
the ninth embodiment. In Fig. 22, in accordance with this ninth 
embodiment, one scene within a broadcast program is displayed by a still 
image as a highlight scene which is reproduced in a CM broadcasting time 
range . when the ending of the CM broadcast is sensed, the present 
watching mode is returned to the program watching mode . 
As the still image to be reproduced, for instance, a prize contest 
source displayed in a broadcast program may be used. The scene of this 
prize contest source is detected as the highlight scene by the analyzing 
unit 22, and the reproducing management unit 27 reproduces this highlight 
scene in the CM broadcasting time range, so that the audiences can 
correctly write down the prize contest source. 

In accordance with the ninth embodiment, as the highlight scene, a 
plurality of frames (at least one frame) contained in the broadcast 
program can be utilized by scanning the frames. As a result, the 
destination address of the prize contest for the audiences, which is 
displayed in the broadcast program, can be correctly written down on 
memorandums and the like, while using the CM broadcasting time range, so 
that the audiences can effectively utilize their own time. 
It should also be noted that the method for detecting the highlight 
scene provided as the still image may be realized by employing either the 
detecting method of the second embodiment or the third embodiment. 
Alternatively, the receiver of the ninth embodiment may be equipped 
further with a means for notifying an end of a CM broadcast to 
audiences 

in such a case that the end of this CM broadcast is sensed. In this 
alternative case, the following selection may be made. That is, while the 
destination address is being written down, when the CM broadcast is 
completed, the still image may be continuously watched by the audiences, 
or the original broadcast program may be again watched by the audiences . 
Therefore, such concern that the audiences must write down the 
destination address by the CM broadcast is ended may be lessened. 

(TENTH EMBODIMENT) 

Subsequently, a tenth embodiment of the present invention will now be 
described. Fig. 23 is a functional block diagram for showing a receiver 
20J according to the tenth embodiment. As indicated in Fig. 23, in the 
receiver of the tenth embodiment, a reproducing management unit 27J is 
different from the above -explained reproducing management unit 27 of the 
first embodiment. 

In other words, since this reproducing management unit 27J switches 
speech (voice) modes when the highlight scene watching mode is selected 
and the program watching mode is selected, the reproducing management 
unit 27 J instructs the decoder 8a to switch these speech modes, if 
required. That is to say, the reproducing management unit 27 J may 
function as a speech control means of the present invention. Other 
structural elements of this receiver 20J are similar to those of the 
first embodiment, so that further explanations thereof are omitted. 
Fig. 24 is a flow chart for explaining the operation of the receiver 
20J according to the tenth embodiment. This receiver operation of the 
tenth embodiment is different from the receiver operation (see Fig. 5) of 
the first embodiment in that, the flow chart of Fig. 24 is made different 
from the flow chart shown in Fig. 5 of the first embodiment as to such a 
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technical point that a speech mode switching process defined at steps 
S1012 and S1017 is interposed between the steps Sll and S12, and also 
interposed between the steps S15 and S03 . The process operations at steps 
other than the above-described steps are the same as those of the first 
embodiment. Processings in the other steps are the same as in the first 
embodiment . 

Concretely speaking, in the case that commencement of a CM broadcast is 
sensed while a broadcast program is watched (step S1002; YES), the 
reproducing management unit 27J selects a highlight scene (step S1010) , 
and then enters both image data and speech data of the selected highlight 
scene into the decoder 8a (step S1011) . 

Furthermore, the reproducing management unit 27 J applies the following 
instruction to the decoder 8a as the speech mode switching process 
operation. This instruction may switch a speech output channel from a 
main speech channel to a sub-speech channel (step S1012) . As a 
consequence, the speech (voice) of the highlight scene is outputted from 
the sub- speech channel. 

Thereafter, in the case that the end of the CM broadcast is sensed 
(step S1008) , the reproducing management unit 27J executes the switching 
operation from the highlight scene watching mode to the program watching 
mode (step S1016) . Subsequently, as the speech mode switching process 
operation, the reproducing management unit 27J switches the speech output 
channel from the sub- speech channel to the main speech channel (step 
S1017) . 

In the above-explained receiver example, the speech of the broadcast 
program is watched via the main speech channel in the program watching 
mode. While the speech of the broadcast program is watched via the 
sub- speech channel in the program watching mode, contrary to the above 
example in such a case that this program watching mode is changed into 
the highlight scene watching mode, this sub- speech channel is switched 
into the main speech channel. In the case that this highlight scene 
watching mode is changed into the program watching mode, the main speech 
channel is switched into the sub-speech channel. 

In accordance with the receiver 20J of the tenth embodiment, when the 
highlight scene is reproduced, both the image of this highlight scene and 
the sub-speech (sub-voice) of this highlight scene are provided to the 
audience. As a result, in particular, when a foreign movie is played, the 
audience watches the Japanese dubbed version of this foreign movie during 
the main broadcasting program, whereas the audience may watch by the 
hero's lines in the original language version, in the highlight scene by 
utilizing the CM broadcasting time. Furthermore, while the audience 
watches the main broadcasting program in the original language, the 
audience may watch the Japanese conversion version of the highlight scene 
during the CM broadcasting time. As a result, the audience may confirm 
such a scene which could not be understood in the original language, 
which may be effectively utilized in the foreign language study using the 
foreign movies . 

(ELEVENTH EMBODIMENT) 

Next, a description is made of an eleventh embodiment according to the 
present invention. A hardware construction of a receiver according to the 
eleventh embodiment is similar to those of the above -explained first 
embodiment. Fig. 25 is a functional block for explaining a receiver 20K 
according to the eleventh embodiment. This receiver 20K owns such a 
structural difference from that of the receiver 20 (see Fig. 2) according 
to the first embodiment, that a segmental highlight scene forming unit 35 
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(will be referred to as a 'forming unit 35' hereinafter) is employed 
between the analyzing unit 22 and the highlight index storage unit 25. 
The forming unit 35 is such a function realized by executing a computer 
program by the CPU2 . The forming unit 35 cuts and sorts highlight scenes 
detected by the analyzing unit 22 into constant lengths thereof. In other 
words, end time instants of the highlight scenes detected by the 
analyzing unit 22 are changed in such a manner that the lengths of these 
highlight scenes become constant, and addresses corresponding to the 
changed end time instants are acquired as end addresses. Then, this 
forming unit 35 stores such a highlight index related to the highlight 
scenes whose lengths are cut and sorted into the highlight index storage 
unit 25. 

As a constant length, for example, a single CM program is normally 
formed by a time duration of 15 seconds, or multiplication values thereof 
{15 seconds, 30 seconds, 1 minute) . A single CM broadcasting time range 
is constituted by combining a plurality of CM programs, and therefore, 
may have a length of either 1 minute or 2 minutes. To this end, the 
forming unit 35 cuts and sorts the highlight scenes in the unit of 15 
seconds. Otherwise, since there are many cases that a one- spot CM program 
is broadcasted in the unit of 1 minute, the forming unit 3 5 forms the 
highlight scenes in the segment of 1 minute. 

As a consequence, the highlight scenes whose lengths are made 
coincident with the length of the CM program can be reproduced while one 
CM broadcasting program is broadcasted which is made coincident with 
either a length of a single CM program or a length of plural CM programs, 
which are broadcasted within one CM broadcasting time range. As a result, 
a time instant when the CM broadcast is ended can be made coincident with 
another time instant when the reproduction of the highlight scene is 
ended. 

In accordance with the receiver of the eleventh embodiment, since a 
length of a single CM program is essentially determined by a preselected 
value, the CM program is formed coincident with the length of the 
highlight scene CM, so that the highlight scene may be reproduced only 
during the CM broadcasting time. In other words, since the forming unit 
35 forms the length of the highlight scene in the unit of 1 minute, in 
such a case that the length of the CM broadcasting time range is 
increased or decreased in the unit of 1 minute, the highlight scene can 
be just inserted into this CM broadcasting time range. As a consequence, 
the audience can completely watch the highlight scene instead of the CM 
program. 

(TWELFTH EMBODIMENT) 

Next, a description will now be made of a twelfth embodiment of the 
present invention. A construction of a receiver according to the twelfth 
embodiment is substantially the same as that of the first embodiment (see 
Fig. 1) . Fig. 26 is a functional block of a receiver 20L according to the 
twelfth embodiment. 

It should be understood that since the receiver 20L is similar to the 
receiver 20 of the first embodiment except for the below-mentioned 
technical aspect, common technical aspects thereof are omitted. 
(12-1) : A highlight scene classifying unit 36 (will be referred to as 
'classifying unit 36' hereinafter) is provided between the analyzing unit 
22 and a highlight index storage unit 25L. 

(12-2) : The input device 37 is provided outside the receiver 20L, and 
also both a user taste registering unit 38 and a user taste database 39 
are provided inside the receiver 20L. 
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The classifying unit 36 corresponds to such a function realized by 
executing a computer program by the CPU 2. The classifying unit 36 
classifies a highlight scene detected by the analyzing unit 22 into any 
one of the plurality of genres. A genre indicates an attribute of a 
highlight scene, for instance, this attribute represents a nature scene, 
an action scene, a love scene, and the like. 

Similar to the analyzing unit 22, the classifying unit 36 may classify 
a highlight scene in accordance with a previously saved classification 
condition, by using a speech recognition of this highlight scene, an 
image recognition thereof, and a combination of these speech/ image 
recognitions. The classification condition may be defined in accordance 
with a screen element contained in a scene, and a trend (directivity) of 
a speech. 

For example, when the classified genre is a natural scene, since there 
is a small number of screen elements constituted by straight lines, in 
such a case that the straight line components of the screen elements of 
the highlight scene are smaller than or equal to a preselected value, the 
classifying unit 36 judges the relevant highlight scene as the natural 
scene, and then classifies this highlight scene into such a genre 
corresponding to the natural scene. 

Also, when the classified genre is an action scene, the following trend 
may exist. That is, an object greatly moves around, and BGM and effective 
sounds become active and strong. As a consequence, in such a case that 
screen elements and sounds of a highlight scene are made coincident with 
the above-explained trend, the classifying unit 36 judges this highlight 
scene as the action scene. 

Furthermore, generally speaking, a love scene is constituted by two 
persons. There is such a trend that voices of these persons are low, and 
BGM such as a ballad is used. As a result, when screen elements of a 
highlight scene is made coincident with this trend, the classifying unit 
36 judges this highlight scene as the love scene. 

It should be noted that the present invention is not limited to the 
above-explained example, but may be applied to the following case. That 
is, when the classification condition is determined in accordance with a 
trend (directivity) responding to an attribute of a specific genre, a 
highlight scene may be furthermore classified into a plurality of genres. 

For instance, while voice of a specific actor and a talent are sampled, 
if a highlight scene contains such voice coincident with the sampled 
voice, then only such a scene that either a specific actor of a talent 
appears may be collected. 

Then, the classifying unit 36 allocates a numeral value indicative of a 
genre to a highlight scene in accordance with a classification result of 
this highlight scene, and stores this numeral value into the highlight 
index storage unit 25L as one of the elements of highlight indexes. 
Fig. 27 is an explanatory diagram for explaining a data structure of a 
highlight index storage unit 25L employed in the receiver of the twelfth 
embodiment. As shown in Fig. 27, this highlight index storage unit 25L 
saves thereinto the numeral values (in this example, any one of 1 to 10) 
indicative of the genres of the highlight scenes in addition to the 
starting address, the starting time instant, the end address, the end 
time instant, and the length of the highlight scene (see Fig. 3), which 
are explained in connection with the first embodiment. 
The input device 37 may be arranged by the pointing device such as the 
keyboard 16 and the mouse 17, a remote controller, or a microphone for 
processing a speech recognition of an audience and a speech recognizing 

® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



httD://nrint.westlaw.com/de^ ,F.#.dataid=BO0558OOOOO... 1 /1 7/2006 



Page 87 of 102 



apparatus. The input device 37 may be used so as to register own tastes 
of the audiences (users) . Concretely speaking, an audience inputs a 
numeral value indicative of the own degree of taste with respect to each 
of previously-prepared genres by employing the input device 37. 
The user taste registering unit 3 8 corresponds to such a function 
realized by executing a computer program by the CPU 2. when the degree of 
taste is entered from the input device 37, the user taste registering 
unit 38 registers this inputted degree of taste into the user taste 
database 39. 

Fig. 28 is an explanatory diagram for explaining a data structure of 
the user taste database 39. As indicated in Fig. 28, the user taste 
database 39 owns such data items as to genres of highlight scenes, and 
also the degrees of taste of audiences corresponding to these genres. In 
this database, the larger the numeral value the degree of taste, the 
higher the taste characteristic. 

it should be noted that in this example, only the table with respect to 
one audience is indicated. Alternatively, while plural sets of such 
tables shown in Fig. 28 are provided, the degrees of taste of plural 
audiences may be registered into these tables. 

A reproducing management unit 2 7L manages reproducing operations of the 
highlight scenes recorded on the buffer disk 21 based upon the CM index, 
the highlight index, and also the content saved in the user taste 
database 39. 

Operations of the receiver 20L according to the twelfth embodiment is 
substantially the same as those of the receiver according to the first 
embodiment, shown in Fig. 5. It should also be noted that the operations 
of a highlight selection process operation defined in a step S10 is 
different from that of the first embodiment. That is, in the twelfth 
embodiment, the below-mentioned operation is carried out at the step S10. 

The reproducing management unit 27L sequentially selects and reproduces 
such highlight scenes which may agree to the taste of the audience from a 
plurality of highlight scenes as a highlight scene to be reproduced while 
a CM program is broadcasted. 

In other words, the reproducing management unit 27L recognizes the 
degrees of taste with respect to the respective genres of the audiences 
with reference to the user taste database 39. Subsequently, the 
reproducing management unit 27L sequentially selects and reproduces such 
highlight scenes of genres in which the degrees of taste of the users are 
high with reference to the highlight index storage unit 25L. As a result, 
the highlight scenes in which the degree of taste of the user is high are 
reproduced with top priority among a plurality of highlight scenes. 
As a consequence, the audience of the broadcast program can watch the 
highlight scenes in the CM broadcasting time range in the order of the 
own desirable taste. 

In accordance with the receiver of the twelfth embodiment, when the 
degrees of taste of the audiences are previously registered, the 
highlight scenes are reproduced in the order of the degrees of taste 
thereof. In other words, in accordance with the twelfth embodiment, the 
highlight scenes can be provided with the audiences in response to the 
tastes which are defined based on the attributes (sex, age, character, 
etc.) of the audience. Therefore, the audiences can have the satisfactory 
feelings made by watching the highlight scenes over a wide range. 

(THIRTEENTH EMBODIMENT) 

Next, a description will now be made of a thirteenth embodiment of the 
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present invention. A construction of a hardware according to the 
thirteenth embodiment is substantially the same as that of the first 
embodiment (see Fig. 1) . Fig, 29 is a functional block of a receiver 20M 
according to the thirteenth embodiment . 

It should be understood that since the receiver 20M is similar to the 
receiver 20 of the first embodiment except for the below-mentioned 
technical aspect, common technical aspects thereof are omitted. 
(13-1) : No switch 28 is employed. A decoder 8b into which only 
broadcast data derived from the tuner 18 is entered is connected in 
parallelto another decoder 8c into which only broadcast data derived from 
the buffer disk 21 is entered. 

(13-2) : A plural screen display unit 41 (equal to display control 
unit) is employed which is connected to the respective decoders 8b and 
8c, and furthermore, to the display apparatus 15. 

(13-3) : A reproducing management unit 27M controls operation of the 
plural screen display unit 41. 

Fig. 30 is a flow chart for indicating operations of the receiver 20M 
according to the thirteenth embodiment. The flow chart of Fig. 30 owns 
such a different step, instead of the process operations defined at the 
steps Sii and S15 in the flow chart of the first embodiment (shown in 
Fig. 5), a plural screen display process operation (step S1312) is 
executed instead of the step Sll, and also a single screen display 
process (step S1317) is executed instead of the step S15 . The process 
operations other than those of the above -explained steps are the same as 
those of the first embodiment. 

Concretely speaking, since the receiver 20M of the thirteenth 
embodiment employs the arrangement of Fig. 29, the broadcast data 
supplied from the tuner 18 is always inputted into the decoder 8b while 
the audience watches the broadcast program. When the commencement of the 
CM broadcast is sensed (step S1302) , the reproducing management unit 27M 
instructs the plural screen display unit 41 in such a manner that both 
the broadcasting screen of the program and the screen of the highlight 
scene are displayed at the same time on the monitor of the display 
apparatus 15 (step S131-1) . 

On the other hand, when the end of the CM broadcast is sensed (step 
S1308), the reproducing management unit 27M instructs the plural screen 
display unit 41 in such a manner that only the broadcast screen of the 
program is displayed on the monitor of the display apparatus 15 (step 
S1315) . In this way, the audience is able to watch the highlight scene on 
a plural screen display during the CM broadcast time range, and when the 
CM broadcast time range ends, to watch the subsequent program on a single 
screen display. 

Fig. 31 illustratively shows an example of a screen display image of 
the receiver according to the thirteenth embodiment, in Fig. 31, 4 
pattern examples 'A' to 1 D' are displayed as a pattern example of a 
plural screen display in a CM broadcasting time range. It should be noted 
that if the plural screen display is realized, then other pattern 
examples than the above -explained patterns 'A' to 'D' may be employed. 
The pattern example 'A* corresponds to such a display pattern that a 
screen of a highlight scene (highlight screen) is displayed in a 
full -sized screen, and a screen received in real time (received broadcast 
screen) is overlapped on this highlight screen located at a lower right 
corner in a small screen display. 

The pattern example 'B' and the pattern example »c correspond to such 
a pattern example that the highlight screen is not overlapped with the 
received broadcast screen. The pattern example 'B' is featured by that 
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the size of the highlight screen is larger than the size of the received 
broadcast screen. The pattern example 'C is featured by that the size of 
the highlight screen is equal to the size of the received broadcast 
screen. 

In accordance with the receiver of the thirteenth embodiment, both the 
highlight screen and the received broadcast screen of the CM broadcast 
are simultaneously displayed on the display apparatus 15 while the CM 
broadcast is carried out. As a result, the audience can watch the 
highlight scene at the same time as when the audience watches the 
received broadcast screen of the CM broadcast. As a consequence, this 
receiver can meet such a requirement of the audience, that although the 
audience wishes to watch only a popular CM program and a CM program in 
which a favorite talent appears, the audience does not wish to watch 
other CM programs than the above -explained CM programs. 
It should also be noted that the highlight scene reproduced in the 
thirteenth embodiment may be acquired by way of the method of the second 
or the third embodiment. 

{ FOURTEENTH EMBODIMENT) 

Next, a description will now be made of a fourteenth embodiment of the 
present invention. A construction of a hardware according to the 
fourteenth embodiment is substantially the same as that of the first 
embodiment (see Fig. 1) . A functional block of a receiver 20M according 
to this fourteenth embodiment is similar to that of the thirteenth 
embodiment (see Fig. 29) . 

It should be noted that operations of the receiver of the fourteenth 
embodiment are different from those of the thirteenth embodiment. In 
other words, in the fourteenth embodiment, in such a case that both a 
highlight scene and a CM broadcast are displayed in a plural screen 
display mode, when the CM broadcast is ended, the plural screen display 
mode (display mode) is changed. Thereafter, when the reproduction of the 
highlight scene is ended, the display mode is advanced to the single 
screen display of the received broadcast screen. 

Fig. 32 is a flow chart for describing operations of the receiver 20M 
according to the fourteenth embodiment. Referring now to Fig. 32, a major 
operation of this receiver 20M will be explained. 

At a step S1402, the CM start sensing unit 23 analyzes the broadcast 
data received from the tuner 18 so as to judge whether or not the CM 
broadcast is commenced. At this time, when the CM broadcast is not yet 
commenced (step S1402; NO), a highlight analyzing process operation (step 
S1403: see Fig. 6) is carried out, and thereafter, the audience watches 
the broadcast program (step S1404) . It should also be noted that the 
processing order of the steps S1403 and S1404 may be reversed. 
Thereafter, when the audience continues to watch the broadcast program 
(step S1405; NO), the process is returned to the step S1401. 
On the other hand, in the case that the CM start sensing unit 23 senses 
the start of the CM broadcast (step S1402; YES), a CM start index storage 
process operation is executed (step S1406; see Fig. 7 (A)). Thereafter, 
the reproducing operation of the highlight scene is carried out until the 
end of the CM broadcast is sensed in a CM end sensing process operation 
(S1407) . 

That is to say, a highlight selection process operation is executed if 
required (step S1410: see Fig. 8). A first plural screen display process 
operation (step S1411) is carried out which is similar to the plural 
screen display process operation (step S1311) of the thirteenth 
embodiment. As a result, the audience can watch the highlight scene in 
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the plural screen display mode (step S1412) . 

Thereafter, when the CM end sensing process (step S1407) is carried 
out, if the reproducing operation of the highlight scene (step S1408; NO) 
and also the CM broadcast is accomplished (step S1409; YES), then a CM 
end index storage process operation (step S1416: see Fig. 7(B)) is 
executed. Thereafter, the single screen display process operation similar 
to that of the thirteenth embodiment is carried out (step S1417) , and the 
present watching mode is advanced to the program watching mode (step 
S1404) . 

On the other hand, when the CM end sensing process operation (step 
S1407) is executed, in such a case that the reproducing operation of the 
highlight scene is not yet ended (in case of highlight 
watching mode) 

(step S1408; YES) , a check is made as to whether or not the CM broadcast 
is ended (step S1414) . 

At this time, when the CM broadcast is not yet ended (step S1414; NO) , 
the process is advanced to a further step S1412. At this step S1412, the 
reproducing operation/plural screen display operation of the highlight 
scene are continued. To the contrary, in the case that the CM broadcast 
is ended while the audience watches the highlight scene (step S1414; 
YES), a second plural screen display process operation (step S1415) is 
carried out, and the display pattern of the plural screen display is 
changed. Thereafter, the process operation is advanced to a step S1412. 
Fig. 33 is an explanatory diagram for explaining a screen display 
example obtained in connection with the operations of the receiver of the 
fourteenth embodiment. In Fig. 33, there are three pattern examples Al, 
Bl, and CI. As indicated in Fig. 33, before the CM broadcast is 
commenced, the received broadcast screen is displayed in the single 
screen display mode. Thereafter, when the CM broadcast is commenced, the 
first plural screen display operation is carried out. In the first plural 
screen display operation, both the highlight screen and the received 
broadcast screen of the CM broadcast are displayed on the monitor at the 
same time. On the respective screens, sizes of screens and ordering of 
display positions are previously given. 

In other words, both the pattern examples Al and Bl are such pattern 
examples that the orders of the highlight screens are high in view of 
screen sizes, and the sizes of the highlight screens are larger than the 
sizes of the received broadcast screens. To the contrary, the pattern 
example Cl corresponds to such a pattern example that the order of the 
received broadcast screen of the CM broadcast is high in view of the 
display position, and the received broadcast screen is displayed in front 
of the highlight screen. 

In such a case that the CM broadcast is accomplished while the audience 
watches the highlight scene, the display mode is changed into the second 
plural screen display mode under control of the plural screen display 
unit 41 by the reproducing management unit 27M. This display mode change 
is carried out by reversing, for example, the order in the first plural 
screen display operation. 

Pattern examples A'l, B'l, and C'l shown in Fig. 33 and corresponding 
to the example of the second plural screen display are such pattern 
example obtained by reversing the ordering of the first plural screen 
display, in which the highlight screen is substituted by the received 
broadcast screen of the program. Thereafter, at a time instant when the 
audience ends watching the highlight screen, the present screen display 
operation is returned to the original single screen display operation of 
the received broadcast screen. 
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In accordance with the receiver of the fourteenth embodiment, even when 
the CM broadcast is ended, since the plural screen display operation is 
executed, the audience can watch the highlight scene and the broadcast 
program at the same time even after the CM broadcast is ended, and 
therefore, it is possible to prevent such watching of the highlight scene 
half way. 

Also, the ordering are previously given to both the sizes and the 
display positions as to the highlight screen and the received broadcast 
screen in the plural screen display operation. While the CM program is 
broadcasted, the order of the highlight screen is set to the high order, 
whereas the order of the received broadcast screen is set to the high 
order after the CM broadcast is ended. 

As a consequence, while one audience who wishes to watch the broadcast 
program in real time is treated with a top priority, a requirement of 
another audience who wishes to completely watch a highlight scene can be 
met in the receiver of this fourteenth embodiment. It should also be 
noted that the ordering operation as to the highlight screen and the 
received broadcast screen may be made opposite to that of the 
above -explained example by manipulation from the audience, 

(FIFTEENTH EMBODIMENT) 

Next, a description will now be made of a fifteenth embodiment of the 
present invention. A construction of a receiver according to the 
fifteenth embodiment may be realized by employing a similar construction 
of the first embodiment {see Fig. 1) . Fig. 34 is a functional block 
diagram of a receiver 20N according to this fifteenth embodiment. The 
receiver 20N is arranged by adding an input device 42, an index screen 
display unit 44, a highlight scene instructing unit 43, and a switch 45 
to the structural elements (see Fig. 2) of the first embodiment. 
The index screen display unit 44 is such a function realized by 
executing a computer program by the CPU 2. The index screen display unit 
44 reads a starting address of each highlight scene stored in the 
highlight index storage unit 25, reads a first scene of a highlight scene 
stored at this starting address from the buffer disk 21, and then, forms 
a still image indicative of the first scene of the highlight scene. 
Then, the index screen display unit 44 saves the formed still image as 
an index, and outputs this saved index to the display apparatus 15. At 
this time, in such a case that the switch 45 is brought into such a 
switching state that the index screen display unit 44 is connected to the 
display apparatus 15, a still image of a single highlight scene, or still 
images of plural highlight scenes are displayed as an index screen (see 
Fig. 36) on the monitor of the display apparatus 15. 

The input device 42 may be arranged by the pointing device such as the 
keyboard 16 and the mouse 17, a remote controller, or a microphone for 
processing a speech recognition of an audience and a speech recognizing 
apparatus. The input device 42 may be used so as to select a desirable 
highlight scene, while the audience refers to the index screen. 
The highlight scene instructing unit 43 is such a function realized by 
executing a computer program by the CPU 2. The highlight scene 
instructing unit 43 is initiated in such a case that the CM start sensing 
unit 23 senses the commencement of the CM broadcast. Then, the highlight 
scene instructing unit 43 switches the switch 45 to the switch side of 
the index screen display unit 44 so as to display an index screen on the 
display apparatus 15. 

Thereafter, when a designation of a highlight scene is entered from the 
input device 42, the highlight scene instructing unit 43 controls the 
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reproducing management unit 27N in order that this highlight scene is 
displayed on the display apparatus 15, and also switches the switch 45 to 
the side of the decoder 8a. 

The reproducing management unit 27N receives the reproduction 
instruction of the highlight scene designated by the input device 42 from 
the highlight scene instruction unit 43. As a result, the reproducing 
management unit 27N inputs such broadcast data corresponding to the 
designated highlight scene into the decoder 8a in accordance with this 
reproduction instruction by way of the manner as explained in the first 
embodiment. As a consequence, the designated highlight scene is displayed 
on the monitor of the display apparatus 15. 

The switch 45 owns a structure substantially equal to that of the 
switch 28. The highlight scene instructing unit 43 causes the switch 45 
to be switched to any one switch side between the decoder 8a and the 
index screen display unit 44. 

Fig. 35 is a flow chart for describing process operations of the 
receiver 20N according to the 15th embodiment in the case that the 
receiver 20N receives broadcast data. Referring now to this flow chart of 
Fig. 35, a major operation executed in this receiver 20N will now be 
described. 

At a step S1502 of Fig. 35, when it is so judged that a CM broadcast is 
not yet commenced, a highlight analyzing process operation (step S1503 : 
see Fig. 6) is executed, and thereafter, an audience watches a broadcast 
program (step S1504). It should be understood that the process sequence 
of the steps S1503 and S1504 may be reversed, as compared with the 
above-explained process sequence. Next, when the audience continues to 
watch the broadcast program (step S1505; NO), this process operation is 
returned to the step S1501. 

On the other hand, in such a case that a commencement of a CM broadcast 
is sensed (step S1502; YES), a CM start index storage process operation 
is carried out (step S1506; see Fig. 7(A)). Thereafter, an index screen 
display process operation is executed (step S1507) . That is, an index 
screen is displayed on the display apparatus 15 by both the highlight 
scene instructing unit 43 and the index screen display unit 44. 
when the index screen is displayed, this index screen is kept displayed 
until the audience (user) designates a highlight scene by manipulating 
the input device 42, or the CM broadcasting time range is ended (namely, 
loop process defined by steps S1507, S1508, and S516) . 
While the index screen is displayed, in the case that the audience 
designates (selects) the highlight scene (step S1508; YES), the 
designated highlight scene is reproduced by the reproducing management 
unit 27N until the end of the CM broadcast is sensed at the step S1509 
(namely, loop process defined by steps S1509 to S1515) . It should be 
noted that in Fig. 35, both the end sensing process operation (step S07 
of Fig. 5) and the condition judging operation (step S08 of Fig. 5) are 
integrated with each other as steps S1509 and S1516. 

In the loop process operation defined by the steps S1509 to S1515, when 
the highlight scene is not yet selected (step S1510; NO), a highlight 
selecting process operation is executed, and then, the designated 
highlight scene is selected (step S1511: see Fig. 8). 
Thereafter, the switch 45 is switched from the broadcast data derived 
from the tuner 18 for the decoder 8a into the data derived from the 
buffer disk 21 (step 1512), and the screen display mode is returned from 
the index image display mode to the normal screen display mode in order 
that the audience watches the highlight scene (steps S1513 and S1514) . 
Thereafter, in the case that the end of the CM broadcast is sensed 

® 2006 Thomson/West. No Claim to Orig. U.S. Govt. Works. 



httn://nrintwest1aw r,nm/de1w^ 



1/17/2006 



Page 93 of 102 



(step S1509; YES) , a CM end index storage process operation (step 1517: 
see Fig. 7(B)) is carried out. Next, in the case that the index screen is 
displayed on the display apparatus 15, the index screen is switched to 
the normal screen (step S1518) , and the switch 45 is switched from the 
broadcast data derived from the buffer disk 21 for the decoder 8a to the 
data derived from the tuner 18 (step S1519) , and then, the present 
watching mode is advanced to the program watching mode (steps S1503 and 
S1504) . 

Fig. 36 illustratively shows a screen display image of the monitor 
according to the 15th embodiment. As indicated in Fig. 36, just before 
the CM broadcast is commenced, the normal screen is displayed on the 
monitor, when the commencement of the CM broadcast is sensed, the normal 
screen is switched into an index screen. The index screen displays as an 
index, a still image of a head screen of such a highlight scene which is 
formed in the index screen display unit 44 (corresponding to index 
providing unit), and is selectable. The indexes are displayed on 
subdivided areas, for instance, which are produced by equally dividing 
the display area of the monitor. 

While the audience refers to the indexes (still images) displayed on 
theindex screen, if a desirable highlight scene is present, then the 
audience designates (selects) this desirable highlight scene by operating 
the input device 42. As a consequence, the index screen is switched to 
the normal screen, and thus, the selected highlight scene is displayed. 
In Fig, 36, symbols 'HA' and ' HB' correspond to the selected highlight 
scene . 

To the contrary, as indicated in Fig. 36, an index of a received 
broadcast program which is selected when the audience wants to watch the 
CM program, or when the audience does not want to watch the highlight 
scene may be contained in the index screen. 

As the index of the received broadcast, for instance, either a still 
image of a broadcast program appeared just before a CM broadcast is 
started, or another still image of the broadcast program appeared just 
after the CM broadcast is commenced may be formed by the index screen 
display unit 44 to be displayed. Alternatively, such a button used to 
select the received broadcast may be displayed as an index of this 
received broadcast. 

In the case that the index of the received broadcast is selected, the 
switch 28 is switched to the side of the tuner 18, and also the switch 45 
is switched to the side of the decoder 8a. As a result, the index screen 
is switched to the normal screen, and the CM broadcast is displayed on 
the monitor. In other words, the CM program may be provided with the 
audience in real time. Thereafter, when the CM broadcast is ended, the 
broadcast program may be continuously provided with the audience. 
In accordance with the 15th embodiment, while the index screen of the 
highlight scene is displayed, when the audience selects a desirable 
highlight scene, this selected desirable highlight scene is reproduced. 
As a result, since the audience can watch the desirable highlight scene, 
the CM broadcasting time range can be more effectively utilized, as 
compared with that of other embodiments. Also, in such a case that such a 
desirable highlight scene is not contained in the index screen, the 
audience may watch the CM broadcast by selection on watching of the 
received broadcast . 

It should be noted that in the 15th embodiment, the still image is 
employed as the index of the highlight scene. This index may be realized 
by such a text indicative of a content of the highlight scene. Also, as 
indicated in Fig. 36, the index screen is not displayed on the area 
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obtained by equally subdividing the index, but may be displayed in a list 
form. 

In the flow chart shown in Fig. 35, in such a case that the length of 
the selected highlight scene is shorter than the CM broadcasting time 
range, after the reproducing operation of the selected highlight scene 
has been completed, the selected highlight scene is reproduced by the 
reproducing management unit 27 until the CM broadcasting time range is 
ended. To the contrary, in the case that the reproducing operation of the 
selected highlight scene is accomplished before the CM broadcasting time 
range is ended, the index screen may be displayed again. 

(16TH EMBODIMENT) 

Next, a description will now be made of a 16th embodiment of the 
present invention. A construction of a receiver according to the 16th 
embodiment is substantially same as that of the sixth embodiment (see 
Fig. 1). It should be understood that in the receiver of the 16th 
embodiment, a digest of the broadcast program which has been so far 
watched by an audience is reproduced after one broadcast program has been 
ended until another broadcast program subsequent to the above-mentioned 
broadcast program is commenced. 

A recognition of a program end and a program start is carried out in 
accordance with the below-mentioned manner. That is, for instance, there 
is such a service that program information (broadcast program: 
'electronic program list') is provided via the Internet and the like. The 
data related to a starting time instant and also an end time instant of a 
program are acquired by utilizing this service. Then, both the program 
end time instant and the program starting time instant can be recognized 
by using these data. An electronic program list is referred to as an ' EPG 
{Electronic Program Guide) ' , and is contained in broadcast 
electromagnetic waves in the BS digital broadcasting system. 
Alternatively, an audience may manually input a broadcast program 
(program starting time instant and program end time instant) into the 
receiver. 

In such a case that a broadcast program is arranged by entering 
combined CM programs after this broadcast program is accomplished, if 
total time of the CM programs is counted from a starting time instant of 
this broadcast program, since a CM insertion ratio with respect to the 
broadcast program is determined. Accordingly; a time duration of the CM 
programs which are inserted into the broadcast program after this program 
is ended until the next program is commenced can be calculated backward. 
The digest may be formed by coupling the program digests which are ■ 
explained in the sixth embodiment. In such a case that the length of the 
digest is desired to be adjusted to be equal to the time duration up to 
the next program, for example, as previously explained in the eighth 
embodiment, the following length adjusting method may be employed. That 
is, while the importance degrees are allocated to the respective program 
digests, the program digests having the higher importance degrees are 
sequentially selected, and the selected program digests are coupled to 
each other. As a result, the length of the coupled program digests is 
adjusted in such a manner that the length of the digest is made equal to 
the length of the CM broadcasting time range between the two continuous 
broadcast programs. 

Fig. 37 is a diagram for indicating a relationship between a write 
address and a read address to a buffer disk in the receiver of the 16th 
embodiment. In Fig. 37, during from when a program 'A' is accomplished 
until a program 1 B ' is commenced, a digest of the program 'A' which has 
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been so far watched is reproduced. At a time instant when the 
commencement of the program 1 B ' is sensed, the present watching mode is 
returned to the program watching mode. 

In accordance with the 16th embodiment, in the CM broadcasting time 
range between the two continuous programs, the digest of the broadcast 
program, which has been broadcasted just before this CM broadcasting time 
range, is reproduced. As a result, the audience can watch the digest of 
such a broadcast program which has been watched after one broadcast 
program is ended and until the next broadcast program is commenced. 
As a consequence, the audience can take another look as to feelings of 
the program. For example, when the audience is impressed with the 
broadcast program, this audience can be deeply impressed with this 
broadcast program by watching the digest of this program. Otherwise, by 
watching the digest of the program, the audience can furthermore have a 
deep understanding of the story of the program, and thus, this audience 
may have other feelings different from the feelings with respect to this 
broadcast , 

It should be understood that the CM end sensing unit 24 for sensing the 
end of the CM broadcast is employed in the above- explained first to 16th 
embodiments. Instead of this CM end sensing unit 24, a time measuring 
unit (timer) may be employed. This time measuring unit is operated as 
follows. When a predetermined time duration has passed after a 
commencement of a CM broadcast is sensed, the present watching mode is 
automatically transferred to the program watching mode. When such a time 
measuring unit is employed, the arrangement of the receiver can be made 
simpler. Moreover, if the CM broadcasting time range is previously 
grasped, then the CM programs can be completely cut. 
It should also be noted that the arrangements of the receivers as 
explained in the first to 16th embodiments may be properly combined with 
each other. 

In the broadcast receiver, the broadcast control method, and the 
recording medium for recording thereon the computer program, according to 
the present invention, the audience need not perform the zapping 
operation. Therefore, it is possible to avoid such a problem that the 
audience may loose his interests as to the broadcast program even in the 
CM broadcasting time range contained in this broadcast program. 
This invention being thus described, it will be obvious that same may 
be varied in various ways. Such variations are not to be regarded as 
departure from the scope of the invention, and all such modifications 
would be obvious for one skilled in the art intended to be included 
within the scope of the following claims. 
CLAIMS EP 3.158791 A2 

1. A broadcast receiver comprising: 

a highlight scene detecting unit for detecting a highlight scene of a 
broadcast program; 

a store unit for storing at least said detected highlight scene of said 
program into a storage device; 

a CM detecting unit for detecting a CM (commercial message) broadcast 
program; and 

a reproducing control unit for reproducing said highlight scene stored 
in said storage device while said CM program is broadcast 

2. A broadcast receiver as claimed in claim 1 wherein: 

said CM detecting unit includes: 

a CM start detecting unit for detecting a commencement of said CM 
broadcast; and wherein 
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when said CM broadcast is commenced, the reproduction of said highlight 
scene is commenced. 

3. A broadcast receiver as claimed in claim 1 or claim 2 wherein: 

the reproduced highlight scene is shown instead of said CM 
broadcast program. 

4. A broadcast receiver as claimed in claim 1 or claim 2 wherein: 

the reproduced highlight scene is shown in conjunction with said CM 
broadcast program. 

5. A broadcast receiver as claimed in any one of claims 1 to 4 wherein: 

said highlight scene detecting unit detects the highlight scene 
based upon an index indicative of the highlight scene contained in 
broadcast data of said broadcast program. 

6. A broadcast receiver as claimed in any one of claims 1 to 5 wherein: 

said highlight scene detecting unit detects the highlight scene in 
response to an instruction issued from the audience. 

7. A broadcast receiver as claimed in any one of claims l to 6 wherein: 
said storage device stores thereinto a data portion of the broadcast 
data corresponding to a predetermined time duration at any time; and 

in such a case that when the CM broadcast is ended, the reproduction of 
the highlight scene has not yet been amplished, said reproducing 
control unit reproduces such broadcast data as appeared just after 
said CM broadcast ended after the reproduction of said highlight 
scene has been completed. 

8. A broadcast receiver as claimed in claim 7 wherein: 

in such a case that when the broadcast data' is reproduced, a next 
CM broadcast is commenced, if a time difference between a broadcast 
time instant and a reproduction time instant exceeds broadcast time 
of the next CM broadcast program, said reproducing control unit 
continues to reproduce said broadcast data without executing the 
reproduction of said highlight scene. 

9. A broadcast receiver as claimed in any one of claims 1 to 8 wherein: 

said reproducing control unit reproduces a program digest 
constructed of a plurality of highlight scenes as said highlight 
scene . 

10. A broadcast receiver as claimed in any one of claims 1 to 4, claims 7 
and 8 wherein: 

said storage device stores thereinto a data portion of the broadcast 
data corresponding to a predetermined time duration at any time; and 
when the CM broadcast is commenced, said reproducing control unit 
reproduces as said highlight scene, a broadcast data portion which is 
stored in said storage device, and is defined from a time instant 
when the CM broadcast is started and until a preselected time 
duration is retraced. 

11. A broadcast receiver as claimed in any one of claims 1 to 4, claims 7 
and 8 wherein: 

said storage device stores thereinto a plurality of highlight scenes to 
which importance degrees are allocated respectively; and 
said reproducing control unit reproduces a highlight scene at a speed 
corresponding to an importance degree thereof. 

12. A broadcast receiver as claimed in any one of claims 1 to 6 wherein: 
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said reproducing control unit reproduces a still image as the 
highlight scene. 

13. A broadcast receiver as claimed in any preceding claim wherein: 
said broadcast program contains first speech (voice) and second speech 
(voice) ; and 

said broadcast receiver is further comprised of: 

speech control means for providing any one of said first speech and 
said second speech when the broadcast program is provided in 
connection with a broadcast time instant; and also for providing the 
other speech between said first speech and said second speech when 
the highlight scene is reproduced. 

14. A broadcast receiver as claimed in any preceding claim wherein: 

said reproducing control unit reproduces such a highlight scene 
having a length which is made coincident with broadcast time of a CM 
program inserted into the broadcast program. 

15. A broadcast receiver as claimed in any preceding claim wherein 
said broadcast receiver is further comprised of: 

a highlight scene classifying unit for classifying the highlight scenes 
stored in said storage device into plural sorts of classifications; 
and wherein 

said reproducing control unit reads out such a highlight scene having a 
sort corresponding to a taste of an audience with having a top 
priority from said storage device to reproduce the read highlight 
scene in such a case that the CM broadcast is commenced. 

16. A broadcast receiver as claimed in claim 4, further comprising: 

a display control unit for displaying at the same time, both an 
image of broadcast data in response to a broadcast time instant and 
an image of a reproduced highlight scene on a single display screen. 

17. A broadcast receiver as claimed in claim 16 wherein: 

said display control unit changes any one of sizes and display 
positions with respect to said display screen as to both a display 
area for said image of the broadcast data and a display area for said 
image of the highlight scene in the case that the CM broadcast is 
ended. 

18. A broadcast receiver as claimed in any one of claims l to 17 wherein: 

said storage device stores thereinto any one of a single set and plural 
sets of highlight scenes; and 

said broadcast receiver is further comprised of: 

an index providing unit for providing an index used to select a 
desirable highlight scene when the CM broadcast is commenced. 

19. A broadcast receiver as claimed in any preceding claim wherein: 

said reproducing control unit reproduces any one of the highlight 
scene and a digest constituted of plural highlight scenes of a 
certain broadcast program during a time period defined after said 
certain broadcast program is ended and until a next broadcast program 
is commenced. 

20. A broadcast control method comprising: 
detecting a highlight scene of a broadcast program; 
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storing at least said detected highlight scene of said program into a 
storage device; 

detecting a CM (commercial message) broadcast program; and 
reproducing said highlight scene stored in said storage device while 
said CM program is broadcast. 

21. A broadcast control method as claimed in claim 20 further comprising: 

detecting a commencement of said CM broadcast; and 

commencing the reproduction of said highlight scene when said CM 

broadcast is commenced. 

22. A broadcast control method as claimed in claim 20 or claim 21 further 
comprising : 

showing the reproduced highlight scene instead of said CM broadcast 
program. 

23. A broadcast control method as claimed in claim 20 or claim 21 further 
comprising : 

showing the reproduced highlight scene in conjunction with said CM 
broadcast program. 

24. A broadcast control method as claimed in any one of claims 20 to 23 
further comprising: 

detecting the highlight scene based upon an index indicative of the 
highlight scene contained in broadcast data of said broadcast 
program. 

25. A broadcast control method as claimed in any one of claims 20 to 23 
further comprising: 

detecting the highlight scene in response to an instruction issued 
from the audience. 

26. A broadcast control method as claimed in claim 22 further comprising: 

storing a data portion of the broadcast data corresponding to a 
predetermined time duration at any time into said storage device; and 

reproducing such broadcast data as appeared just after said CM broadcast 
ended after the reproduction of said highlight scene has been 
completed in such a case that when the CM broadcast is ended and the 
reproduction of the highlight scene has not yet been accomplished. 

27. A broadcast control method as claimed in claim 26 further comprising: 

commencing a next CM broadcast if a time difference between a broadcast 
time instant and a reproduction time instant exceeds broadcast time 
of the next CM broadcast program in such a case that when the 
broadcast data is reproduced, and 

continuing the reproduction of said broadcast data without executing the 
reproduction of said highlight scene. 

28. A broadcast control method as claimed in any one of claims 20 to 27 
wherein: 

said highlight scene is a program digest constructed of a plurality 
of highlight scenes. 

29. A broadcast control method as claimed in any one of claims 20 to 22, 
claims 26 and 27 further comprising: 

storing a data portion of the broadcast data corresponding to a 
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predetermined time duration at any time into said storage device; and 

reproducing a broadcast data portion which is stored in said storage 
device, and is defined from a time instant when the CM broadcast is 
started and until a preselected time duration is retraced when the CM 
broadcast is commenced, as said highlight scene. 

30. A broadcast control method as claimed in any one of claims 20 to 22, 
claims 26 and 27 further comprising: 

storing a plurality of highlight scenes to which importance degrees are 
allocated respectively into said storage device; and 

reproducing a highlight scene at a speed corresponding to an importance 
degree thereof . 

31. A broadcast control method as claimed in any one of claims 20 to 25 
further comprising: 

reproducing a still image as the highlight scene. 

32. A broadcast control method as claimed in any one of claims 20 to 25 
wherein : 

said broadcast program contains first speech (voice) and second speech 
(voice) ; and 

any one of said first speech and said second speech is provided when the 
broadcast program is provided in connection with a broadcast time 
instant; and also the other speech between said first speech and said 
second speech is provided when the highlight scene is reproduced. 

33. A broadcast control method as claimed in any one of claims 20 to 25 
wherein: 

said highlight scene owns a length which is made coincident with 
broadcast time of a CM program inserted into the broadcast program. 

34. A broadcast control method as claimed in any one of claims 20 to 25 
further comprising: 

classifying the highlight scenes stored in said storage device into 
plural sorts of classifications; 

reading such a highlight scene having a sort corresponding to a taste of 
an audience with a top priority from said storage device in such a 
case that the CM broadcast is commenced; and 
reproducing the read highlight scene. 

35. A broadcast control method as claimed in claim 23, further 
comprising : 

simultaneously displaying both an image of broadcast data in 
response to a broadcast time instant and an image of a reproduced 
highlight scene on a single display screen. 

36. A broadcast control method as claimed in claim 35 further comprising: 

changing any one of sizes and display positions with respect to 
said display screen as to both a display area for said image of the 
broadcast data and a display area for said image of the highlight 
scene in the case that the CM broadcast is ended. 

37. A broadcast control method as claimed in any one of claims 20, 22, 
24, and 25 further comprising: 

storing any one of a single set and plural sets of highlight scenes into 
said storage device; and 

providing an index used to select a desirable highlight scene with the 
audience when the CM broadcast is commenced. 

38. A broadcast control method as claimed in any one of claims 20 to 25 
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further comprising: 

reproducing any one of the highlight scene and a digest constituted 
of plural highlight scenes of a certain broadcast program during a 
time period defined after said certain broadcast program is ended and 
until a next broadcast program is commenced. 

39. A recording medium for recording thereon a program used to cause 
acomputer to execute: 

a step for detecting a highlight scene of a broadcast program; 
a step for storing at least said detected highlight scene of said 
program into a storage device; 

a step for detecting a CM (commercial message) broadcast program; and 
a step for reproducing said highlight scene stored in said storage 
device while said CM program is broadcast . 

40. A computer readable recording medium as claimed in claim 39 wherein: 
said CM broadcast detecting step detects a commencement of the CM 
broadcast; and 

said program is further comprised of: 

a step for starting the reproduction of said highlight scene when 
said CM broadcast is commenced. 

41. A computer readable recording medium as claimed in claim 39 or claim 
40 wherein: 

said program is further comprised of a step for showing the 
reproduced highlight scene instead of said CM broadcast program. 

42. A computer readable recording medium as claimed in claim 39 or claim 
40 wherein: 

said program is further comprised of a step for showing the 
reproduced highlight scene in conjunction with said CM broadcast 
program. 

43. A computer readable recording medium as claimed in any one of claims 
39 to 42 wherein; 

in said highlight scene detecting step, the highlight scene is 
detected based upon an index indicative of the highlight scene 
contained in broadcast data of said broadcast program. 

44. A computer readable recording medium as claimed in any one of claims 
39 to 42 wherein: 

in said highlight scene detecting step, the highlight scene is 
detected in response to an instruction issued from the audience. 

45. A computer readable recording medium as claimed in claim 41 wherein: 
said program causes said storage device to temporarily store thereinto a 
data portion of the broadcast data corresponding to a predetermined 
time duration; and 

in such a case that when the CM broadcast is ended, the reproduction of 
the highlight scene has not yet accomplished, said program reproduces 
such broadcast data appeared just after said CM broadcast is ended 
after the reproduction of said highlight scene is reproduced. 

46. A computer readable recording medium as claimed in claim 45 wherein: 

in such a case that when the broadcast data is reproduced, a next 
CM broadcast is commenced, if a time difference between a broadcast 
time instant and a reproduction time instant exceeds broadcast time 
of the next CM broadcast program, said program continues to reproduce 
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said broadcast data without executing the reproduction of said 
highlight scene. 

47. A computer readable recording medium as claimed in any one of claims 
39 to 46 wherein: 

said program reproduces a program digest constructed of a plurality 
of highlight scenes as said highlight scene. 

48. A computer readable recording medium as claimed in any one of claims 
39 to 41, claims 45 and 46 wherein: 

said storage device stores thereinto a data portion of the broadcast 
data corresponding to a predetermined time duration at any time; and 
when the CM broadcast is commenced, said program reproduces as said 
highlight scene, a broadcast data portion which is stored in said 
storage device, and is defined from a time instant when the CM 
broadcast is started and until a preselected time duration is 
retraced. 

49. A computer readable recording medium as claimed in any one of claims 
39 to 41, claims 45 and 46 wherein: 

said storage device stores thereinto a plurality of highlight scenes to 
which importance degrees are allocated respectively; and 
said program reproduces a highlight scene at a speed corresponding to an 
importance degree thereof. 

50. A computer readable recording medium as claimed in any one of claims 
39 to 44 wherein: 

said program reproduces a still image as the highlight scene. 

51. A computer readable recording medium as claimed in any one of claims 
39 to 44 wherein: 

said broadcast program contains first speech (voice) and second speech 
(voice) ; and 

said program provides any one of said first speech and said second 
speech when the broadcast program is provided in connection with a 
broadcast time instant; and also provides the other speech between 
said first speech and said second speech when the highlight scene is 
reproduced. 

52. A computer readable recording medium as claimed in any one of claims 
39 to 44 wherein: 

said program contains such a highlight scene having a length which 
is made coincident with broadcast time of a CM program inserted into 
the broadcast program. 

53. A computer readable recording medium as claimed in any one of claims 
39 to 44 wherein: 

said program is further comprised of: 

a step for classifying the highlight scenes stored in said storage 
device into plural sorts of classifications; and 
said program reads out such a highlight scene having a sort 
corresponding to a taste of an audience with having a top priority 
from said storage device to reproduce the read highlight in such a 
case that the CM broadcast is commenced. 

54. A computer readable recording medium as claimed in claim 42 wherein: 

a step for displaying at the same time, both an image of broadcast 
data in response to a broadcast time instant and an image of a 
reproduced highlight scene on a single display screen. 
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55. A computer readable recording method as claimed in claim 54 wherein: 

said program changes any one of sizes and display positions with 
respect to said display screen as to both a display area for said 
image of the broadcast data and a display area for said image of the 
highlight scene in the case that the CM broadcast is ended. 

56. A computer readable recording medium as claimed in any one of claims 
39, 41, 43, and 44 wherein: 

said storage device stores thereinto any one of a single set and plural 

sets of highlight scenes; and 

said program is further comprised of: 

a step for providing an index used to select a desirable highlight 
scene when the CM broadcast is commenced. 

57. A computer readable recording medium as claimed in any one of claims 
39 to 44 wherein: 

said program reproduces any one of the highlight scene and a digest 
constituted by plural highlight scenes of a certain broadcast program 
during a time period defined after said certain broadcast program is 
ended and until a next broadcast program is commenced. 

END OF DOCUMENT 
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